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ABSTRACT 

This report examines the effects of early efforts to 
link the Elementary Secondary Education Act's (ESEA's) Chapter 1 (now 
Title I) programs to state and district education reforms, which are 
standards-based. The report focuses on how Chapter 1 standards and 
accountability requirements connect with new state-^level standards, 
curricula, and assessments for all children; how new curriculum 
frameworks and higher standards are changing teaching and learning in 
Chapter 1 programs; how new state assessments track individual 
student progress and improve overall program accountability; and how 
successfully integrated Chapter I programs and evolving systemic 
reforms can provide lessons for Title I policy. Data were gathered 
during visits to five state departments of education and nine 
districts within the states of Arizona, California, Kentucky, 
Maryland, and New York. Reforms had been implemented at each site for 
three or more years. Key findings include the following: Leading-edge 
states and districts have attempted to link changes in Chapter 1 to 
their own reform efforts; the implementation of standards and new 
assessments is a slow and unstable process; the states have 
disseminated documents that outline achievement and expectations, but 
these vary in depth, breadth, and the amount of information they 
provide about curriculum and pedagogy; The Chapter 1 program is a 
valuable resource for capacity building in several states and 
districts; and local leadership depends on effective management and 
community involvement. Appendices contain an overview of program 
linkages in the case study crstricts, a table showing the status of 
new assessment development in case study states, and examples of data 
reported for state assessment and accountability programs. (Contains 
67 references.) (LMl) 
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Executive Summary 



Ti Jtudy examines the eifects of early initiatives that connected programs funded by Chapter 
1 of Title I of the Elementary and Secondary Education Act (ESEA) to standards-based, systemic 
education reform in selected states and school districts. Its purpose is to gain insights that can be 
applied in implementing and evaluating the reauthorized Chapter 1 program, as amended by ESEA. 
Title I, and related federal programs as systemic reform moves forwiui in the states. It addresses the 
following questions: 

(1) How are Chapter 1 standards and accountability requirements linked with new state- 
level standards, curricula, and assessments for all children? 

(2) How are new curriculum frameworks and higher standards changing teacliing and 
learning in Chapter 1, and how are new state assessments used to track individual 
student progress and improve overall Chapter 1 program accountability? 

(3) What are the lessons for Title I policy to be learned from sites that successfully 
integrated Chapter 1 programs and evolving systemic reforms? 



Data collection too’ . place from March through May 1994. in visits to five state departments 
of education and nine districts within Arizona, California. Kentucky, Maryland, and New York. 
Selection of the states was based on infonnaaon about the history of state reform and its integration 
with Chapter 1; these are states where multiple indicators showed reform had been implemented for 
three or more years. The state Chapter 1 directors each identified two or three districts that were 
active partners in developing the reform agenda and in coordinating district and state reforms. Tois 
sampling procedure yielded a group of sites with these characteristics: 

(1) Each state had recently instituted new curricula and instructional procedui’es th, t 
applied to aU students; the districts had participated in shaping state reform agendas 
and had begun local implementation 

(2) State and local Chapter 1 curricula and assessment reforms had been in place for three 
or more years 

(3) The state and local regular education and Chapter 1 changes were integrated both 
formally and informally 
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(4) Each district was committed to achieving student educational goals consistent with 
emerging national goals, and using multiple strategies of student assessment-including 
performance-based procedures— to direct ins’^ciion and track the accountability of 
Chapter 1 programs 

(5) Districts were sufficiently large (8,000 students or more), demographically diverse, 
and geographically varied so that their experiences with changt would resemble many 
Chapter I programs nationally 



The experiences of these sites are not generaiizable to the nation as a whole in 1994, By 
design, however, they illustrate responses to reform in varied contexts. 

Among the districts and schools vis** /I, which are somewhat unusual in the degree to which 
they embrace reform, the implementation of systemic initiatives is a work in progress. Their 
experiences shed light on the factors driving chaiige in the current reform environment-especially 
new arrangements for high-stakes assessment-and on the tremendous amount of work still to be done 
to realize the promise of standard-setting and assessments, curriculum development, capacity building, 
and site-based management. 



Standards arid assessments are areas of considerable controversy and difficulty for these sites; 



The states vary in their definitions of content and performance standards 

The implementation of standards and new assessments has turned out to be a slow and 
often unstable process, lasting for several years and undergoing political challenges 
along the way 

Procedures for levying sanctions on schools with poor performance, after an adequate 
period of supportive assistance, are not yet in place and remain a focal point for 
debate 

Practical problems are evident in the use of new assessments in Chapter 1 . The most 
innovative assessments are planned for only a few grade levels and thus cannot be the 
basis for student selection for targeted programs in other grades. Little or no 
information from new state tests is available in a format and on a schedule that make 
it instrucdonally useful to teachers. 



Curriculum frameworks and curriculum are likewise areas where much remains to be done: 






The states have disseminated documents that outline achievement expectations, but 
these vary in depth, breadth., and the amount of information they provide about 
curriculum and pedagogy 



• Traditional practices prevail in many Chit ^ ' .:<’ogTams; if teachers are going to 
teach to new expectations under Title I, o v ' ’ ^leed more curriculum resources 

With a ubiquitous need for capacity budding, state and local education agencies are trying to 
deliver many kinds of help more effef;tiveJy and teachers are beginning a lengthy learning process. 



Chapter 1 stands out as a resource for capacity building in several states and districts 

Because technical assistance and staff development are often pieced together from 
several sources, many schools are experiencing numerous, often clashing, 
programmatic initiatives 



Where site-based management and community involvement are key ingredients in the reform 
agendd, conflicting visions of reform have to be reconciled. 



Effective local leadership depends on such strategies as widespread ownership of 
change, clear goals and feedback cycles, a long time horizon, stable organizational 
structures at all levels, and flexibility in adapting reforms to local contexts 



Title I policy in the coming years will have to set directions for districts and states that are 
facing the challenges of defining and implementing their own standards-based reforms. The 
experiences of these vanguard sites suggest, most centrally. (1) that policy makers must not expect too 
much too soon, and (2) that they must determine what roles Title I should play in framing and 
underwriting the transition to new standards, assessments, curriculum, and teaching skills. 

Specifically: 

• Title I will have to offer clear requirements for accountability, coupled with enough 
flexibility to accommodate rapid change in the sr.:e of the assessment an. For 
example, it is dear firom the assessment practices and capabilities that exist in these 
sites that new assessment methods will need to be complemented by more traditional 
strategies for student selection and program planning. 

• In the transition period, there is a tremendous need for funding to support the 
development of new assessment instruments and to bolster local and state capacity in 
using ^em. Policy makers will have to determine the ground rules by which Title 1 
can legitimately fund development and assistance in these areas without 
inappropriately providing general aid to states and local education agencies (LEAs). 

« Title I policy makers and program managers might want to establish more explicit 
roles for the program in state or local efforts to develop curriculum or adapt it for 
low-achieving students. Some soiuce of leadership in curriculum development is 
needed if Title I students are to escape their traditional diet of basic skills. Just as the 



program has always been a source expertise and initiative in the field of evaluation, 
it could conceivably take on a similar role in curriculum. But here, too. the issue of 
general aid will be a difficult one. 

Title I policy makers and program managers could strongly encourage states and 
districts to focus professional development on the practical application of new 
standards, curriculum, and instruction with disadvantaged students. Currently, more 
peripheral instructional programs continue to dominate professional development in 
these districts. 

Schoolwide programs in these sites offer welcome flexibility in targeting special 
services, but they do not trigger a rethinking or overhaul of the basic program. If 
policy makers want to see schoolwide programs stimulate reform, they will have ' o 
sharpen this message. 

Targeted programs can offer as much instructional coherence as schoolwid' . rograras. 
A policy emphasis on program continuity and quality is likely to have ay Jong an 
effect on improving program coordination as is the promotion of the s'.nooiwide 
approach. 



I. Purpose and Study Design 



On behalf of the Office of the Under Secretary in the U.S. Deparanent of Educadon» Policy 
Studies Associates (PSA) examined the effects of initiatives begun before ESEA Title I reauthorization 
that connect Chapter 1 programs to standards-bastd state and district education reform. The purpose 
of the study was to gain insights from the implementation of Chapter I programs within the context of 
leading edge systemic reforms so that these insights could be applied to the new Title I program and 
other efforts to link federal program support with systemic reforms. 

This paper begins with a discussion of the study’s purpose and design. Following an 
overview of key reform issues in study states, we describe and analyze program implementation in 
states and districts, emphasizing the linkages between local Chapter I programs and state reforms. 

We conclude with implications for Title I policy development. 



Research Questions 

This study explored state and federal progrsun coordination in nme districts located in five 
I'ading reform sutes. Three questions framed our research: 



(1) How are Chapter 1 standards and accountability requirements linked witi^ new state- 
level standards, curricula, and assessments for all children? 

(2) How are new curriculum frameworks and higher standards changing teaching and 
learning in Chapter 1, and how are new state assessments used to track individual 
student progress and improve overall Chapter 1 program accountability? 

(3) What are the lessons for Title I policy to be learned from sites that successfully 
integrated Chapter 1 programs and evolving systemic reforms? 



These questions are examined within the context of two decades of research on educating at- 
risk students, recent federal and state legislation, and coordinated state and local efforts to improve 
schools serving high concentrations of poor students. 
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The Context of Federal and State Systemic Reforms 



Recent research highlights shifts in the characteristics of regular classrooms and the most 
successful special programs for at-risk students. In the past decade, accelerated learning opportunities 
have begun to replace pull-out remediation (Levin. 1987, 1992); some rote learning has given way to 
problem solving and analytic thinking (Pogrow, 1990; Resnick & Klopfer, 1989); common, 
cognitively rich currijulums are increasingly the starting point for all students in core subjects 
regardless of students' prior experiences and learning opportunities;^ and coordinating regular 
classroom learning and education services for at-risk students enhances the academic demands for the 
lowest achievers (Knapp & Shields, 1990; Means & Knapp, 1991). New curriculum developments 
are also being assessed against an array of performance-based measures that reflect the cognitive 
demands and challenges children confront in their everydav lives (U.S. Depaitment of Education, 
1993c). These changes have begun to offer disadvantaged students a quality of education that is 
consistent with that provided to their peers. 

Such research inspires innovations in teaching and learning and organizational arrangements. 
Policy shifts known as "systemic reforms" arise partly from federal initiatives and partly from state 
and local frustration with the limited effects of prior reforms (Massell & Fuhnnan, 1994). Systemic 
refoims are coherent structural and organizational adjustments, united by a common set of goals and 
approaches to educating children. Increasingly viewed by state and national policymakers as a viable 
direction for education in the United States, these reforms are also central to federal programs begun 
since the early 1990s by the Department of Education and the National Science Fouiid*'rion (O’Day &, 
Smith, 1993; see also Fuhrman, 1993; Fuhnnan, 1994).^ 

Earlier reviews of systemic reform (Fuhrman, 1994; Massel & Fuhnnan, 1994) and Chapter 1 
suggested the following prevailing context for connecting state education reform and the new Title I: 



’ See Knapp & Shields (1990); Natriello, McDill, & Pallas (1990); Slavin. Karweic, & Madden (1989); and 
Stringfield, Winfield, Millsap, Puma, Gamse, & Randall (1992). 

^ Researchers racked Che developmem of these reforms at regular intervals in the past several years. See 
the Consortium ior Policy Research in Education (Massell & Fuhrman, 1994, among others); Educadou 
Commission of the States (ECS, 1994); National Governors' Association (NGA, 1993). Policy Studies 
Associates has monitored the development of assessment changes (Laguarda, Breckenridge, & Hightower, 1994; 
Pcchxnan & Laguarda, 19931. as has the Council of Chief State School Officers (Bond, 1994; Selden, Hemphill. 
& Blank, 1993). 
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State reforms are in various stages of a continuing evolution, even in states where 
reform agendas have been in place for many years. State curricula, standards, and 
assessments develop first in a few grades at a time and in traditional content areas of 
reading, language arts, and mathematics, followed by frameworks in various o±er 
core disciplines. 

Until 1994, Chapter 1 regulations and monitoring procedures mandated accountability 
and assessment practices that differed from those used by states involved most actively 
in designing new curricula, standards, and performance-based assessments. In 
particular, federal requirements to use norm-referenced tests for reporting restriaed 
the extent to which states could use emerging alternative assessments to monitor 
student learning and evaluate services in Chapter 1 programs. As a result, schools 
serving Title I students have limited experience with the innovative assessment and 
evaluation expectations in Title I. 



Consensus about the need for reform emerges gradually, even in those states with a 
long-standing openness to innovation. There are many different-ofeen competing- 
ideas about how to accomplish common goals. With so many new ideas, the progress 
of reform frequently relies on a few risk takers who forge ahead during periods of 
uncertainty and sustain their commitment in the face of controversy. 

Institutionalizing new organizational structures and teaching strategies requires 
stability and strong leadership. Momentum for innovation typically gains the firmest 
footing first in schools or districts with enough policy contiruity and institutional 
suppon to allow room for the inevitable false or slow starts. Frequent changes at the 
top levels of administration and dramatic shifts in funding play havoc with reform. 



Context shape,s the transition to new curricula, standards, and assessmcrits-and 
context varies significantly. Each local education agency (LEA) and state grapples 
with a different array of policy and planning issues unique to its political environment 
and region. Thus, the outcome of systemic reform depends on a ategic balance of 
federal, state, and local regulatory constraints and flexibilities that spond to 
individual state and local political contexts. 



The final report of the national assessment of Chapter 1, 



(U.S. 



Department of Education, 1993c), points out that, despite the complexities, some schools and districts 
have made Chapter 1 a strong partner in local and state education reform since the 1988 
reauthorization of ESEA. Where Chapter I reform is occurriiig, states have begun to restructure their 
curricula and assessment strategies, and they have established clearer standards about what students 
should know and be able to do as a result of their schooling Of particular interest to federal policy 
makers are understanding how new curricula and accom., iility systems affect the quality of education 
for disadvantaged students and coordinating these new systems so that they benefit all students. 

Where Chapter 1 programs have a multiyear history of implementing reforms, we can learn what 
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kinds of policy planning and assistance on state or local levels support or obstruct successful 
integration of statewide reform on behalf of disadvantaged youth. 

Two pieces of legislation enacted in 1994 promote systemic reform through a new agenda for 
serving disadvantaged students. Together, ESEA, reauthorized by the Improving America’s Schools 
Act, and the Goals 2000: Educate America Act will reshape the federal government’s role in assisting 
schools. These laws promote standards-based systemic changes on the basis of two assumptions: (1) 
school improvement begins with an ambitious vision of what students should know and be able to do; 
and (2) ail students can and will attain a high level of academic achievement, given the oppoituniry. 
Ambidou^ content and performance standards and new state assessment systems challenge traditional 
assumptions about the performance of disadvantaged children and redefine how schools, districts, 
states, and the federal government collaborate to provide supportive educational services. 

The 1994 reauthorization of ESEA draws federal categorical programs in education into a 
working partnership with each other and with state and local education policies and practices. Over 
the years, federally funded education programs have become separated fiom mainstream education, 
operating as add-ons and working at the margins. Although the original purpose of Title 1 was to 
‘mtensify and personalize instruction for low-achieving students, many of the puINout programs that 
evolved over the years limited students to a diet of low-level and rote skills. The separation of 
federal and mainstream programs also meant that students who participated in Chapter 1 did not 
benefit from classroom instructional and cuniculum improvements promoted by state and local 
reforms. Too often, such programs failed to engage students with intellecmally compelling 
opportunities to advance their thinking or to participate in demanding academic programs (U.S. 
Department of Education, 1993c). 

With Goals 2000 and the 1994 reauthorization of ESEA, Congress increased expectations for 
schools that serve disadvantaged children. The legislation encourages federal, state, and local 
programs to work together to achieve the following goals: 

• High standards that ensure all students-especially the most disadvantaged-reach the 
same high academic goals 

• Increased focus on teaching and learning for staff as well as for students 

• Flexibility for schools to stimulate initiatives that increase local responsibility for 
student learning 

• Support for parents, linking them with available school and community resources for 
their families 



Resources targeted for children with the greatest needs 






This study documents progress toward these goals in states and districts that are on the leading edge 
of cliange. 



Study Design 

We used nine case studies of state reform activities and district-level Chapter 1 programs to 
identify Chapter 1 and reform linkages, determine their effects, and analyze the resulting insights for 
policy. Sites were identified in three stages during fall 1993. First, from inforraation about the 
history of state refonn and its integration with Chapter 1 , we chose five states-Arizona, California, 
Kentucky, Maryland, and New York-where multiple indicators showed refonn had been implemented 
for three or more years. Next, state Chapter 1 directors each identified two or three districts that 
were active partners in developing the refonn agenda and in coordinating disffict and state reforms. 
Finally, we conducted telephone interviews with district Chapter 1 coordinators and LEA personnel 
and reviewed background information about each prospective site to obtain information on the 
following: 

• School district and Chapter I program demographics (approximate size of the district 
and its Chapter I program, percentage of students from low-income families, and 
other relevant demographic features) 

• Organizational anangements (grades served, subjects or services offered, program 
configuration) 

• Key reforms affecting regular education and Chapter 1 

• District and Chapter 1 linkages to statewide reforms (curriculum and instruction, 
standards, assessments, and accountability procedures) 

Following this data review and in consultation with the U.S. Department of Education, we 
selected nine study sites: Sunnyside and Tucson Unified School Districts, Arizona; Hayward and 
Long Beach Unified School Districts, California; Christian and Fayette Counties, Kentucky; Frederick 
County, Maryland; Community School Distria One and Niagara Falls City Schools, New York. The 
sites shared these characteristics: 
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(1) Each state had recently insdtuted new curricula and instructional procedures that 
applied to all students; the districts had panicipated in shaping state reform agendas 
and had uegun local implementation 

(2) State and local Chapter 1 curricula and assessment reforms had been in place for three 
or more years 

(3) The state and local regular education and Chapter 1 changes were integrated both 
formally and informally 

(4) Each district was committed to achieving student educador goals consistenc with 
emerging national goals, and using multiple strategies of stuuent assessment-including 
performance-based procedures-to direct instruction and track the accountability of 
Chapter 1 programs 

(5) Districts were sufficiently large (8,000 students or more), demographically diverse, 
and geographically varied so that their experiences would reflect a wide range of 
Chapter 1 programs nationally 



From March through May 1994, PSA researchers conducted one-day site visits to state 
agencies and two- to three-day visits in the nine districts. Researchers interviewed administrators, 
teachers, and parents; visited classrooms and taiked informally with students; and reviewed 
guidelines, curriculum materials, and other documents. 



Appendix 1 describes the participating districts, summarizes the major features of their 
Chapter 1 programs, and indicates connections with the state reforms. 



Limits of the Generalizability of Findings 



The districts and schools included in this study are distinguLhed by a number of enviable 
features. Although they differ in locale, size, ethnic make-up, and proportion of students in poverty, 
they have in common an openness to experimentation, an ability to adapt, and a belief in the benefits 
of change. The comment of one district leader is typical: "Whenever there is a reform movement 
from the state, this district always tries to respond." 

Educators in these sites are not novice change agents but have a long-standing involvement in 
school improvement and a commitment to flexible management and curriculum-based reforms. 
Program leaders, principals, and teachers haA long tenures-many have been in the districts more 
than ten years. It was not uncommon to meet clusters of 20-year veterans who have worked together 




"since way back in the days of the old Title 1/ These professionals are working in the conununity 
they call home. They have invested themselves in their schools; they know what works and whai 
does not; and they are determined to succeed, even against increasingly difficult odds. 

in short, the insights about the dynamics of change in the districts in this study reflect the 
perspectives of experienced change agents in communities that support change; different insights 
might be drawn from contexts where mnovation is less welcome and more suspect. 
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n. Key Influences on State and Local Chapter 1 Policy Development 



In this section, we describe, major n?itional, state, and local influences on policy development 
for Chapter 1. We begin with a discussion of national policy shifts, including changes in Chapter 1 
law and regulations in the 1980s and 1990s, and conclude with an overview of recent state and local 
reform activity. 



National Reforms 

Major policy initiatives from the early 1980s set the stage for emerging systemic refonns. 
State leaders trace recent trends to the awareness created by A Nation at Risk (National Commission 
on Excellence in Education, 1983), and by business leaders ard national policy makers who rallied 
behind the belief chat business as usual was unacceptable education policy and radical improvement 
was needed to rescue America’s schools from deepening decay. Respo.iding to this call for change, 
the states we examined took a number of actions: they established more challenging graduation 
reqitiremencs and stricter accounubility; invested in teachers' professional development and 
curriculum writing; lestrucmred organizations to involve teachers and communities more centrally in 
decision making; set a minimum achievement for all students; and instituted statewide testing to 
monitor student prepress. Policy makers expected that all students would go beyond minimal reading 
and mathematics to become skillful readers and users of language arts who attain proficiency in 
"hard" academic content (Porter, Archbald, & Tyree, 1991), including mathematics, social studies, 
and sciences. 

By the end of the 1980s, Chapter 1 policy had also begun to reflect higher academic standards 
and more ambitious goals. The 1988 Augustus F. Hawkins-Robert T. Stafford Elementary and 
Secondary School Improvement Amendments shifted away from remediation and minimum 
competencies toward the expectation that all students would progress toward grade-level acbievemeni 
These amendm ents stressed that Chapter 1 programs were to bring students to grade-level proficiency 
in both "basic" and "more advanced* skills. Encouraging greater program flexibility, the 
amendments targeted resources to schools with relatively high poverty levels while providing parents, 
local practitioners, and community members with stronger planning and decision-making roles. The 
changes promoted more frequent use of in-class instructional models and schoolwide projects to 
upgrade basic academic programs in Chapter 1 schools. In particular, the amendments encouraged 
districts to use "schoolwide projects" to address education challenges in the highest poverty schools 



Schoolwide projects allow districts to combine federal, local, and other external funds in eligible 
schools to enhance student services for every student. This integration of funds gives school-site 
leaders increased flexibility to adapt research-based practices to the overall instructional program, 
reduce class size, increase professional development, and involve parents and communities in school 
decision making and other schoolwide services. 

Just as state reforms advocated clearer accountability. Chapter 1 also intensified its 
accountability guidelines for evaluating student performance. New evaluation and monitoring 
requirements introduced by the Hawkins-Stafford Amendments gave local coordinators the leverage to 
insist that schools continually re-examine and alter unsuccessful approaches. As a result, when 
students failed to meet a threshold of improvement on standardized tests, district and ultimately state 
agencies became involved in overseeing the plans for changes in policy or practice (U.S. Department 
of Education, 1990, 1993b). 

The Hawkins-Stafford amendments also advocated ifequent and regular coordination among 
Chapter 1 and regular education staff to minimize disruption in students' education, insisting that 
Chapter 1 fit smoothly into the regular program (U.S. Department of Education, 1993b). By 1992 
the Department of Education made coordination even more feasible by allowing Chapter 1 teachers to 
provide "incidental” assistance to non-Chapter I students, as long as Chapter 1 continued to focus on 
the educational needs of disadvantaged students. These new regulations further encouraged teaching 
arrangements to reduce the isolation of Chapter I students in pull-out programs, thus minimizing the 
labeling, the stigma, and the educational disruption often associated with such programs. 

The National Education Goals set by the nation’s governors in 1989 stepped up efforts by 
some states to bring coherence to disparate policies. In the states we studied, this coherence meant 
instituting goal-focused policies and forging new partnerships within and among state and local 
education agencies, across differently funded programs, and with many constituents-students, 
families, communities, and businesses. The hope was to coordinate education initiatives and program 
funds from state, local, and federal sources to engage students in rigorous, intellectually .substantive 
learning experiences. By the early 1990s, states and districts were incorporating into their education 
programs lessons learned from a generation of experiments, drawing from developmg kno^vledge 
about school organization and change, tea'Lnmg, children's learning, and curriculum content 
standards. 




State and Local Reforms 



Proponents of systemic reform envision coherent state and local policies, based on clear goals 
and high academic standards, as keys to upgrading schools serving disadvantaged students (Elmore & 
Fuhrman, 1994; Fuhrman, 1993; Smith, 1994). Ideally, curriculum standards, written into state and 
local "frameworks" or curriculum guidelines and assessed by new, more informative testing methods, 
define what students should know and be able to do as a result of their years in school. Evidence of 
how well student meet the standards is to be measured on a proficiency continuum that defines 
unambiguous levels of expected accomplishment in widely agreed upon content and performance 
standards. School professionals-teachers and administrators-are continually learning, expanding tlieir 
conteat knowledge and pedagogical expertise, and developing a common idea of what the standards 
are and how to ensure that all children achieve them. Parents and communities are active contributors 
in planning the education programs that affect their children. Districts use site<based management as 
a mechanism for sharing decision making among local authorities, teachers, and the communities the 
school serves. When states establish ambitious goals and clear standards and reinforce them with 
coordinated policies, the theory assumes, the effects will promote greater policy coherence leading to 
beneficial outcomes tor all students. 

The states and districts we studied have incorporated many features of systemic reform into 
their educational agendas. Visions express high expectations for all students; revised curriculums 
reflect evolving national professional standards; and new assessments and accountability procedures 
provide clearer indication of what children know and are able to do. State educational agendas share 
a common vision, but similarities across states and districts end with the broad themes. Each state 
uniquely defines its content and performance standards, curriculum frameworks, and accountability 
systems. Content standards take a number of forms: they are ** essential skills," "academic 
expectations," "frameworks," or "outcomes." Performance and proficiency expectations are 
idiosyncratic: they are set at different grade levels; they have different content requirements; and 
they are measured with different assessment instruments and scoring procedures. 

Even with the new systemic orientation, state reform in the present era emphasizes continuity 
with the past. According to top administrators in state and local education agencies, building on past 
strengths and willingness to let go of failures are central to the success of their more recent initiatives. 
New York’s Board of Regents was so firmly committed to its successful initiatives of the early 1980s 
that A New Compact for Learning (NCL), its recent reform strategy, strengthens but does not replace 
the earlier guidelines. California attributes advances made in the 1990s to an ambitious legislative 
agenda begun more than a decade ago. In Arize na, legislative committees involving parents, 
teachers, and business professionals set higuCi standards for grades K to 12 students in the mid-1980s 




Both Kentucky and Maryland significantly enhanced accountability demands after 1989, but their 
education leaders also report that changes begun earlier in that decade set the stage for the 
accomplishments of the past five years. 
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ni. Systemic Reform and Chapter 1 in States and Districts 



We now turn to a discussion of state and local reform strategies in the five states and the nine 
districts we studied. Following a summary of each state’s major systemic reforms, we describe 
Chapter 1 and reforms in districts and present an overview of the coordination of Chapter 1 and the 
basic programs in the districts studied. Table 1 summarizes the major reform components across the 
five states. Additional detail appears in two appendices; Appendix 2 provides detail on the status of 
the new state assessment programs; Appendix 3 gives examples of assessment and accountability data 
reports state agencies used in 1994. 



Arizona 

Sfih!t!e,E9fprm 

Continuing a sutewide improvement effort that had been evolving since the mid-1980s, 
Arizona’s state legislature in 1990 adopted the Arizona Student Assessment Program (ASAP), one of 
the nation’s first performance-based statewide assessments. The assessment legislation followed six 
years of goal setting and cuniculum development. In the mid-1980s, task forces involving state 
legislators, state school board members, parent:, teachers, and business leaders participated in 
defining Essential S kills in 11 content areas. The task forces wrote Essential Skills documents 
specifying "student outcomes"-the core competencies students would be expected to attain-and 
"examples of indicators" to suggest tasks students should be able to complete if they achieve the 
outcomes (Arizona Department of Education (ADE), 1993, p. vii). 

According to officials in both district and state offices, classroom use of the Essential Skills 
was modest until 1990 when the legislature formally mandated the assessment program, its scoring 
standards (called rubrics), and the annual publication of data on student progress through state and 
local media channels. When the state guidelines failed to inspire local action, state policy makers 
turned to the Essential Skills documents and the ASAP as mechanisms for upgrading the quality of 
teaching and for ensuring that students were learning the expected content. 

Arizona’s reform legislation of 1990 gave each district the authority to determine performance 
levels that students are expected to attain on the state tests (ADE, 1993) and mandated the 
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Table 1 

M^or Reforms In Case Study States^, Spring 1994 



REFORM COMPONENTS 


AZ 


CA 


KY 


MD 


NY 


Curriculum frameworks^ 




/ 




! 

Planned 


1 


Curriculum goals/outcomes/skiils^ 


/ 




/ 


/ 


Planned 


Instructionai materials &. technology 
selection guided by curriculum 




/ 


✓ 




Planned 


Performance-based assessments 


✓ 


/ 


✓ 


/ 


Planned 


Norm-referenced stare assessment 
(for non-chapter 1 monitoring) 


✓ 






/ 


✓ 


Student-level performance standards^ 




/ 








School & district report cards 




/ 


/ 


/ 




School-based program planning & 
decision-making flexibility 


✓ 


/ 


✓ 


/ 


y 


School review/improvement process 


Planned 


/ 


Planned 


/ 


Planned 


Accountability sanctions 


Planned 




✓ 


/ 




Cemfreadon and professional 
development tied to curriculum 




/ 


y 




Planned 


Extended time (early childhood and 
before and afterschool programs) 




/ 


y 


y 


Plaimed 


Family & community involvement 




/ 


y 


y 


/ 


Integrated family, health, and social 
services 






y 




Planned 



NOTE: Features of state refonn are being implemented (<0 or planned; an empty cell indicates the state has no 
current plans to implement this component. 



* CunicuIuxD frameworks elaborate on the subject matter of disciplines, mcluding goals, content, and thinking processes 
involved with vising the discipline. They explore the philosophic foundations, visions, and ways of knowing the subject, as 
well as define the boundaries of the skills and knowledge domains to be mastered. Frameworks establish the parameters of 
a content-specific learning environmem. present insiruccional alternatives, and model teaching and assessment approaches 
They may include concepts, goals, and skills lists, but their most significant feature is the extended discussions of content 
and discipUn^-speciilc teaching processes. 

^ Curriculum goals, outcomes, and skills are summaries, outlines, or lists of content expectations. In some cases, they 
reflect the state’s content standards; in other cases they are simply the key skills to be taught. In contrast to frameworks, 
these documents minimize discussions of philosophy, content. iDSirticdonai approaches, and assessment processes. 

^ Student perfonnance standards refer to the levels of mastery that define competence on assessments. They are defmed 
by task- or test-specific rubrics or by summary scores in a tested knowledge domain. Student-level standards are distinct 
from school or district standards in that they reflect the individuafs specific level of accomplishment in a particular content 
area or on a particular task. 




development c" locally defined District Assessment Plans (DAPs) (ADE, 1993). DAPs coordinate 
state and local assessments by reporting student progress toward attaining the Essential Skills in 
reading, writing, and mathematics, as measured by locally administered tests. Districts are free to 
develop their own assessments paralleling the new performance-based state assessments or to adopt 
alternatives to the state’s models. Through ASAP, the state audits student progress on a subset of 
Essential Skills in assessments of reading/ianguage arts, mathematics, and writing administered 
aimually to ail students in grades 3, 8, and 12, and it continues to track progress on traditional tesis 
by administering partial batteries of norm-referenced tests each fall in grades 4, 7, and 10. 

Coordinating the Essential Skills with the ASAP is. by design, a process of "teaching to the 
test." In interviews, school personnel reported that sample tests promote integrated instruction, 
higher-order thinking, and applied learning and are therefore a sound basis for instruction. They 
expect that students who know how to answer the questions on the sample tests will succeed when iihe 
state test asks them to apply what they know in context-embedded tasks. Promoters of this reform 
strategy argue that because ASAP tasks model the best teaching activities and establish clear 
evaluation standards, they provide a common reference point for guiding instruction and evaluating 
student performance statewide. Although this "high-stakes" approach to assessment is controversial,^ 
state and local reform proponents argue that solid student performance on ASAP usks assures 
participating communities that children are applying their developing knowledge practically and with a 
high degree of proficiency. 

After the 1990 legislation, the state's Chapter I program tightened its connection with regular 
education by aligning its goals with the Essential Skills and offering extensive staff development to 
show teachers how to model ASAP tasks and use rubrics as scoring guides and standards. The 
Chapter 1 state office urged districts to frame their desired outcomes in the same terms as the 
Essential Skills and encouraged teaching with sample ASAP-style tasks that use rubrics as in-class 
evaluation criteria. At the same time, the state Chapter 1 direaor and his staff shifted the role of the 
state office from monitoring to technical ^sistance. 



^ The state and district officials interviewed in this snidy were enthusiastic supporters of the high-stakes 
assessment, believing it to be a successful staff development tool for teachers and a motivating strategy for 
students. By contrast. Noble and Smith (1994) repon a more controversial story, suggestmg that Arizona’s new 
assessments are having the same narrowing effect on the curriculum as the traditional assessments did. 



Features of Chapter I in Arizona Districts 



The Arizona sites in this study are two neighboring districts located in the Tucson 
metropolitan area in the southeastern part ot the state. Both serve highly diverse populations. The 
Tucson Unified School District (TUSD) is in the city’s urban core, and the Sunnyside Unified School 
District (SUSD) is located in an economically disadvantaged community on the outskirts of the ciiy.^ 

Sunnyside and Tucson anchor both Chapter 1 and their local reforms in community-centered 
goal setting and strategic planning processes. The districts align their curriculums with the Essential 
Skills and with the ASAP. Their organizational structures place Chapter 1 personnel in roles as 
mentors and program facilitators, helping coUej^es connect the state and district assessment 
procedures to the regular education of disadvantaged students. The local research departments 
provide schools with evaluation data for school planning and classroom use. 

Sunnyside and Tucson Chapter 1 programs offer preschool and extended-day kindergartens, 
literature- and writing-based language arts programs, hands-on mathematics, and professional 
develo{ mem. SUSD incorporates compiemeatary ideas from a variety of innovations supporting the 
education of students at risk, including cooperative learning, behavior management strategies that 
involve the whole class in problem solving, and strategies that emphasize the teacher’s role as 
knowledgeable decision maker and guide. TUSD is eyperimenting with muiti-age primary classes 
organized around interdisciplinary projects and various parent education and involvement programs, 
including special programs for four-year-olds and their families. It also has invested extensively in 
Reading Recoveiy^ Mid its Spanish-language counterpart, Descubriendo La Lectura, an intensive 
piogram that enables students to acquire the problem-solviag habits-and the resulting compctence-of 
good readers by the end of first grade. 

Chapter 1 instruction in Sunnyside occurs within regular classrooms, using targeted Chapter 1 
programs. When the district reviewed options for serving Chapter 1 students, it determined that 
targeted programs conducted within regular dassrooms-more than schoolwide projects-maximize the 
quality of instruction for students. Chapter 1 program facilitators-highly regarded master teachers- 
manage Chapter 1 services by helping teachers and aides upgrade tlie quality of in-class instruction 
for all students, especially the lowest achievers. Chapter 1 instructional aides work under the 



^ SUSD enrolls about 13,300 students in grades preR-lI, About 80 percent of the students are minorities: 
72 pcicem Hispanic, 3 percent African American, 3 percent Native AmericaiL Nearly 65 percent of the 
Sturms qualify for free or reduced>price lunches. TUSD enrolls about 57,000 students in grades pieK-l2. 
About 48 percent of the students are minorities: 37 percent Hispanic, 6 percent African American, 4 percent 
Native American, and 2 percent Asian. Almost 44 percent of students receive free or reduced-price lunches. 



supervision of classroom teachers in regular classrooms and before and after school with small groups 
of children, some of whom may not be in Chapter 1. 

This approach makes Chapter 1 program facilitators also the key change agents within 
schools. They keep informed about new instructional techniques and the evolution of state assessment 
and scoring methods for mathematics, reading, and language arts, and they lead ongoing, school- 
based staff development that promotes the adoption of innovations districtwide. Facilitators also offer 
continuing professional guidance to instructional assistants and tutors in each Chapter 1 school and 
support tlie outreach function of parent-involvement assistants. Sunnyside’s district-level research and 
evaluation division is a significant resource to Chapter 1, documenting student progress in each SUSD 
school and periodically providing item analyses of student achievement on school district assessments. 
Schools also use the DAP results to monitor their progress on district goals. 

Tucson t^es a different approach to intensifying services for Chapter 1 smdents and 
coordinating them with state refonns. Since the late 1980s, Tucson has encouraged all schools to 
adopt schoolwide project models, and by 1993-94, only schools with more than 80 percent of the 
students receiving ft'ee or reduced-price lunches participated in Chapter 1 . As in Sunnyside, Chapter 
1 staff are instructional support teachers and professional developers. TUSD’s Chapter I is based on 
the "whole school concept" and aims to provide services so well integrated into the routine of the 
whole school as to make the program "virtually transparent'' (TUSD. 1994, p. 1). 

Tucson makes Chapter 1 indistinguishable Ifom the regular program by selecting from an 
array of approaches that tit a schooKvide emphasis; small class size, multi-age primary groups, 
extended-year schedules with inter-session enrichment activities, and six Family Resource and 
Wellness Centers scattered in or near schools diroughout the city. TUSD’s bilingual education policy 
maintains smdents’ non-English language resources while developing their English-speaking skills. 
Because so many Chapter 1 participants are limitc'! in their English proficiency. Chapter 1 funds 
some bilingual teachers who teach in students’ home languages. 

Principals report that Tucson’s goals and its annual strategic planning cycle— known as 
ACTion 2000-are prominent considerations in school-level decisions about improving educational 
services for smdents at risk. Schools annually write improvement plans that area superintendents 
review to verify that the locally and externally funded programs are fully coordinated. The district 
encourages school plans that advance witbin-schoo) collaboration and principal participation in 
instructional planning. The emphasis on reflective planning has led many schools to value the 
opportunity to participate in Chapter 1 "program improvement", recognizing the potential of the 





technical assistance and the small grants from the state Chapter 1 office to improve their 
organizational and instructional capacity. 



California 



State Reform 

California’s current education reform began in 1983 with Senate Bill 813, an omnibus reform 
package including more than 80 provisions for improving the state’s elementary and secondary 
schools. The state’s "curriculum frameworks" were among the many change intended to expand 
educational opportunities and upgrade the content and quality of instruction for all students. 

Provisions also included financial incentives for local school districts to extend the school day and 
year, move stringent high school graduation requirements, higher teacher salaries, authorization for 
school district-based teacher training programs to alleviate severe shortages of qualified instructors, 
and a new professional category called "mentor teachers." In the same year. California began 
introducing changes in curriculum, textbooks, testing, and professional development that constitute the 
major elements of today’s systemic reforms (California Department of Education (CDE). 1993a). 

California's curriculum frameworks are unique. Written over a ten-year period by teams of 
state and national curriculum experts, the frameworks embody "constructivist" learning theory- 
advocating active roles for learners— and outline new "thinkiiig/meaning" cunicuiums that require 
students to apply what they know to practical situations. Their purpose is to delineate changes in the 
content and processes of teaching in all major subjects and to demonstrate the shift to new, research- 
based instructional strategies. Over the years, the frameworks have become the foundation for 
preservice teacher education and certification, textbooks, instructional materials and technology, 
teacher and administrator staff development, and collaborations of subject matter experts. 

By 1994, the CDE had issued eight frameworks-English/language arts, mathematics, science, 
health education, history and social sciences, foreign languages, the arts, and physical education. 
Curriculum revision is ongoing in California, occurring cyclically every eight years in every 
discipline. The 1993 update of the language arts framework-adding appendices on phonics and 
iostniaional grouping to address concerns raised about the earlier version of the framework-brought 
all the state’s frameworks through at least one full cycle of revision since framework-guided 
curriculum began in the early 1980s. 



Interlocking "subject matter projects"— teacher networks— are vehicles for disseminating the 
best eaching methods using the frameworks. The subjea matter projects connect the state's most 
talented teachers and colleagues in the universities in a process that expands their knowledge base and 
pedagogic expertise, enabling the teachers to share what they have learned with colleagues in their 
schools. The networks thereby become a resource all teachers can use to increase tlieir knowledge of 
curriculum and pedagogy collaboratively. The California Math Project, a prototype "subject m;»tter" 
project launched in the early 1980s, is an example of this strategy at work. It operates at 17 sites for 
three to four weeks at a time, linking "teacher leaders" with university- and district-based 
mathematics educators. It has been a major discipline-based resource for teachers trying to learn the 
content and pedagogy they need to incorporate California's mathemafrcs framework and the national 
mathematics standards into their classroom routine. 

Curricultim frameworks in California significantly predated the state’s new assessment 
program, so the California Learning Assessment System (CLAS) was organized around the 
frameworks’ curriculum and instruction recommendations. CLAS was a framework-aligned, 
performance-based assessment system that was plagued by funding shorrtalls and political controversy 
almost from its inception. While it had strong advocates among framework users and reform leaders, 
some citizen groups obje:ted to a number of its features. CLAS detractors criiicized it first for using 
open-ended questions that require students to reflect on and, in some people's viev/, inappropriately 
argue a point of view or a set of beliefs. Second, critics objected that students took a sample of tiie 
total test in each subject-not the entire test-so that statewide progress could be evaluated but 
individual student achievement could not be. 'fhis approach minimized the t,.'sting time for individual 
students and reduced costs, but it precluded giving parents progress indicators on their children. 
Finally, claims that CLAS failed to provide "reliable individual smdeat scores , . . and an appropriate 
mix of questions designed to assess students’ mastery of basic skills . . (DiMarco, 1994, p 36) led 
the governor to put tL** testing program on hold by vetoing its funding in the summer of 1994, The 
governor assured citizens that the delay of CLAS was only temporary, however, pending plans to 
adjust the test in response to their concerns (Olsen, 1994, p. 13). A problem with this delay is that 
schools— including those with Chapter 1 programs-were, by 1995, without a framework-based 
assessment tool for evaluating progress toward the state’s curriculum standards 

Still, the Chapter 1 program is not deterred by the problems facing CLAS. The state office 
advocates that districts use the frameworks as the fotmdation of Chapter 1 , assuming that all students 
can learn the content the frameworks define to achieve proficiency on assessments (Walker. 1993) It 
sets a priority on helping Chapter I schools adopt the state curriculum goals by helping schools 
coordinate Chapter 1 resources, state reforms, and frameworks-based instruction. The state office 
considers schoolwide Chapter 1 projects die best approach to ensure all students achieve to the same 




academic goals, "Our function," the state Chapter 1 director explains, is to "train school people on 
how to plan, how to implement schoolwide projects, and how to get parents involved/ Besides 
technical assistance that stresses schooJwide implementation. Chapter I has an especially well- 
developed program of joint state-local assistance with program improvement. 

California’s ten Chapter 1 service regions are school districts’ technical-assistance partners. 
Through the service regions, the state Chapter 1 office hosts quarterly meetings on such issues as 
interpreting ESEA rules and regulations, altemadve assessment, and instructional strategies that 
support low-achieving students. Exemplary Chapter 1 schools are showcased at annual California 
Compensatory Education Achieving Schools conferences. To complement its own activities, the state 
Chapter 1 office collaborates extensively with county and district education offices to coordinate state 
and local reform. The state Chapter 1 office also funds participation by 40 schools in the state’s 
Program Improvement Initiative and strongly encourages schools to join the Elementary Alliance, one 
of California’s many reform-oriented professional development networks. 

Integration of Chapter 1 with the state’s basic education program is further encouraged by two 
complementary monitoring and review processes. The Consolidated Compliance Review (CCR) 
serves a monitoring function for categorically funded programs, and the Program Quality Review 
(PQR) helps all schools evaluate their instruction and curriculum. Since 1984, school districts have 
been required to complete the CCR for all categorical programs, including Chapter 1, state 
compensatory education, and bilingual education (CDE, 1993c). Every four years, districts review 
core programs and services provided to low-achieving students to determine whether student programs 
are coherent and coordinated, to demonstrate that students in categorically funded programs also have 
access to the core curriculum, and to verify that supplemental funding streams are interconnected. 

The goal of the PQR " . . . is to enable the entire school community to focus, through extensive 
discussion and self-examination, on how curriculum and instruction can be improved so that all 
students in the school can be fuUy engaged in a high-quality thinking, meaning-centered cuniculum ' 
(School Improvement Office, 1993, p. 2), Through this review, schools examine and compare 
samples of student work in one specific curriculum area with the vision in the corresponding state 
curriculum framework and with additional PQR criteria. The faculty-led PQR process leads schools 
to develop a multiyear improvement plan, incorporating the recommendations that emerge from the 
self-examination. 

PQR is also a tool for Chapter I program improvement. The state’s 1989 Chapter 1 program 
improvement plan recommends each identified school analyze its general education program, compare 
it with PQR quality standards, and assess how effectively it uses categorical resources to strengthen 
its regular instructional program. 



Features of Chapter 1 in Caiifomia Distrirtig 



We visited two California districts for this study, Hayward Unified School District (HUSD), 
located in a low-wealth small town ten miles south of Oakland, and Long Beach Unified School 
District (LBUSD) in Los Angeles County.* Like other California districts, both faced severe budget 
cuts and coatinuing fiscal austerity in recent years. In response, top managers turned to local 
educators and communities to help make the tough decisions about how to maintain the effectiveness 
of schools in the face of continuing budget reductions. 

Both districts favor schoolwide and in-class Chapter 1 strategies, along with extending the 
time students spend in school through year-roimd and before- and after’School programs. Chapter 1 
resources also supplement the two districts’ continuing involvement in state-sponsored staff 
development and discipline-based networks. A striking feature of these districts is that many of their 
leaders served in Chapter 1 programs earlier in their careers. Experience in Chapter 1 is a highly 
regarded jumping-off point for moving up the organizational ladder-firom school Chapter I facilitator 
to principal and, later, to the district office. As a result, top-level district personnel are alert to the 
effect systemwide policies might have on Chapter 1 as well as to how Chapter 1 helps achieve district 
goals. 



At the elementary school level, Hayward’s Chapter 1 program serves students within 
classrooms, advocating in-class and schoolwide strategies, and it relies on connecting state and locally 
developed cuiriculum frameworks to achieve this goal. The distrid has long relied on professional 
development to maintain high-quality compensatory education, and funding limits have not changed 
this focus. The district sends represent^ves to the state’s FQR training so that all schools-including 
all Chapter 1 schools-prepare for a year for the outside review before it is formally implemented. In 
many schools, the teacher mentor program and Wednesday afternoon staff meetings are resources for 
coordination and capacity building. The district also relies on the county office for many professional 
development services. As a result, even in fiscally restricted times, teachers can access a 



^ Haywan-* serves roughly 20,000 students. Approximately 44 percent of the students are white, 31 percent 
are Hispanic. 17 percent are African American, and 16 percent are Asian. Filipino, and Pacific Islander. 
Approximately 38 percent of the students have limited English proficiency, most speaking Spanish or 
Vietnamese. Almost one-half of Hayward students qualify for free and reduced-price lunches. Long Beach 
eoroils almost 78.000 students. The student population is 36 percent Hispanic, 23 percent white. 

19 percent African American. 16 percent Asian. 3 perccm Filipino, and 2 percent Pacific Islander. About one- 
third of the students have limited English proficiency; many speak Spanish or Cambodian at home. 
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smorgasbord of professional opportunities such as conferences on linguistics, informational lectures on 
conducting PQR, classes on the learning styles of second-language learners, and seminars on 
curriculum development. 

One Hayward schoolwide program offers programs before and after school and staggers 
student schedules to reduce the student-teacher ratio in reading and mathematics classes. When this 
strategy is used, half of the school’s students begin reading class at 8:30 a.m., and the others arrive at 
9:30 a.m. In some schools, usually during a reading or mathematics period, an instructional assistant 
joins the regular teacher for more one-on-one teaching. Other schools lower their student-teacher 
ratios through the Joint efforts of the resource teacher in the computer laboratory, the regular teacher, 
and one instructional assistant. Tutoring programs and sbeltered-Engiish mathematics and science 
also target Hayward’s large limited-English speaking population. Mentor teachers in Chapter 1 
schools meet one-on-one with colleagues while substitute teachers, funded by categorical funds, 
supervise classes. At a Junior high, however. Chapter I services are more traditional, consisting of a 
computer lab that puUs students out of other classes to practice basic skills and team computer 
application. 

In Long Beach, literacy has been a major Chapter 1 focus in recent years. To stan beginning 
readers properly, the district has formally adopted Reading Recovery for its Chapter 1 schoolwide 
programs. Besides investing in the long-term training required for teachers to implement this one-on- 
one tutoring program, Long Beach has participated in the pilot of the Spanish version of Reading 
Recovery. Descubriendo La Lectura. Through a 12-week program. "Early Literacy Inservice 
Course" (ELIC), Chapter 1 has trained virtually all primary teachers to apply Reading Recovery 
principles in the larger classroom context. Training sessions include demonstrations and peer 
coaching. Intermediate teachers take a course using a similar format, "Literacy and Learning 
Inservice: Four to Eight" (LUFE), which extends this approach to support the literacy development 
of older students. Also widespread in LBUSD Chapter 1 schools are interdisciplinary teaching, 
reading and writing across the curriculum, hands-on science and mathematics, and cooperative 
learning. Where students are limited in their English proficiency, these innovative practices are 
conduCTed in students’ primary languages. 

LBUSD annually creates school report cards, called Performance Review Indicators for 
Strategic Management" (PRISM), to show how the major elements of the schools’ comprehensive 
program helps students achieve district objectives. For each school, the repon identifies the mission, 
presents student outcome data and other evidence of success, and lists activities coinciding with school 
objectives. When school improvement falls below identified goals, the LBUSD research office helps 
schools target instruction by distributing Chapter 1 test score information and "Student Improvement 



Listings" created from district and Chapter 1 data. The district also makes extensive use of the 
regional educational laboratory and the subject matter projects at nearby state university campuses. 
Finally, Long Beach is developing local cuniculum and performance standards in ail subjects, a 
process that includes Chapter 1 teachers. 



Kentucky 



State Reform 

The 1990 Kentucky Education Reform Act (KERA) overhauled the state education system in 
response to a 1988 lawsuit by 66 school districts challenging the constitutionality of the state’s public 
school financing. Under the banner "world-class standards for world-class kids," the state instituted a 
reform with ten interlocking components, including curriculum and assessment programs organized 
around six broad goals and 57 accompanying academic expectations.^ The academic expectations 
summarize "what Kentuckians want all students to be able to do with what they know" (Kentucky 
Department of Education (KDE), n.d.). A curriculum guide, Transformations (KDE, 1993), is an 
extensive resource for designing local airricuiums, planning instruction on the academic expectations, 
and recommending new pedagogical processes and in-class evaluation strategies. The guide also 
advises teachers how to incorporate into their teaching new instructional materials, technoiog)', 
community resources, and alternative ways of using time in school. 

KERA funded reform through a combination of state and local taxes. A one-cent sales tax, 
earmarked for KE.RA iiiiplementation, increased education funding by a total of $950 million from 
1990 to 1992, with each school distria receiving at least a 12-percent increase in support (NGA, 
1993). DisiricLs-espec tally poor ones-received as much as 25-percent increases in funds for staff 
development, family and youth resource centers, reduced class size (especially in the primary grade), 
and Site-based management (SBM) councils. 

The state measures stu^ 'ut educational progress annually through the Kentucky Instructional 
Results Information System (KIRIS), a three-pronged ? sessment system that is largely performance- 
based but also includes multiple-choice questions, she answer essays, and portfolios of student work 



® Since 1990 academic expectations and their ensuing names have changed several times. Because of public 
concern over various aspects of the outcomes-based program, the original 75 "learner outcomes* were revised 
by dropping the affective outcomes not measured on the state test and recasting remaining outcomes as 57 
"academic expectations" (Kentucky Department of Education, 1994). 




in writing and matheoiadcs. KIRIS is an innovative accountability program that establishes a progress 
standard for schools on the basis of a combination of test re^'^ults and measures of attendance and 
graduation rates. By 1996, according to KERA, rewards or sanctions will be distributed to schools 
and districts according to their achievement results on both cognitive and noncognitive measures 
(KDE, 1994a; 1994c). 

Although Kennicic>' ’s curriculum guide and KIRIS have received widespread national 
attention, other lesser-known facets of KERA are also having significant impact, including: early 
childhood programs with preschools for four-year-olds from low-income families; continuous progress 
elementary programs merging kindergarten, first, and second grades into single, primary-grade 
classrooms; new professional certification and staff development for teachers and administratois; 
school-based decision making; upgraded technology to electronically connect schools, districts, :jid 
the state; investment in other new educational technology; community and business partnerships; 
improved social services, including in-school family and youth services centers; and several programs 
restructuring state and local school governance, management, and financing. These programs mark a 
radical and rapid change in the state, away from traditional basic skills-criented instruction toward 
developmental, content-focused approaches. Explaining the change, a state administrator observed: 

We’re in a revolution in this state. There’s been a major shift in the goals. We’ve headed to 
writing an lEP for every child. We need to go through many stages of learning before we 
achieve the goals.... At the same time, our population is becoming more at risk.... We’re 
one-fifth into the process, and we’re on track, but it’s tough. 




After KERA took effect, the state Chapter 1 office was merged into the office of the Deputy 
Commissioner for Learning Support Services. The reorganization connected regular education and 
Chapter 1 to improve program development and coordination. Chapter I reframed its guidelines for 
districts to better coordinate federal and state initiatives, focusing local attention on the new KERA 
academic expectations and KIRIS. "KERA really caused us to relook at the federal Chapter 1 law," 
explained a state official. "We took the law as it was written and pushed it as far as we could." The 
state office also encouraged schools to use five core teaching strategies to organize instruction: 
acceleration, higher-order thinking, in-class services, variable teaching and learning approaches, and 
valuing diversity and learner strengths; and it distributed translation guides to conven planning, 
evaluation, and reporting into terms consistent with KERA mandates. 

Both the high visibility and high stakes of the state’s new assessment system achieve the goal 
of focusing attention on the state's content standards-its testable achievement expectations (KDE, 
1994b). At the same time, state funding for professional development reinforces this focus. KERA 
allocated four inservice days to all teachers, and local districts may opt to allocate up to five 
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additional days to professional development that advances teachers' understanding of the new content 
standards and assessment strategies. By law, districts must develop a local plan for professional 
development connected directly to school and district needs assessments. Statewide consortia are 
offering the training schools and districts request, using both Chapter 1 and regular education staff as 
course leaders. Added to what is available from Chapter 1, state-fuuded professional development 
increases the range and depth of staff development, brings speciaiisvs into buildings, and sends 
teachers out of the classroom to observe innovative programs in other locales. 

One problem reformers face in undertaking such massive change is that so much simultaneous 
innovation requires fine-tuning new procedures and policies continuously until they are efficiently in 
place. "Mistakes will be made,” implementation leaders caution, especially with the use of a 
powerful technolog/ such as KIRIS that has many components-test items, administration procedures, 
reporting formats, and programinin^ requirements, among others. Furthermore, many constituencies 
need to be served, some who will support the changes once they understand them, others who may 
sharply criticize them. Friendly and adversarial critics question every phase of implementation. 
Nevertheless, KERA reforms have remained largely intact, despite a close race between the process 
of refining the system tedmicaliy (KDE, 1993c) and the continuing public criticism that threatens it 
(Harp, 1994). A state assessment staff member acknowledged he and his colleagues keep coming 
back to this persistent question about Kentucky’s process: 

The public policy issue is this: Can you live with a system that’s imperfect, where some of 
the rewards in any given year may be unjust-although. over time, the imperfections will even 
out? Will the public tolerate the ambiguities that are inherent m the process? 



Features of Chapter 1 in Kentucky Districts 



Christian and Fayette Counties are two Kentucky districts in which KERA, local reform, and 
Chapter 1 complement one another.’ Christian County, in western Kentucky, is largely a rural 
county, even though its county seat, Hopkinsville, is the sixth-largest city in the state. Fayette 
County, located in central Kentucky, is the home of the University of Kentucky and Transylvania 
University, and near several other state universities, Fayette is an educated, suburban county with an 
inner-city core of low-income families. 

Chapter 1 programs have been a source of these districts’ innovations for many years, 
sponsoring a number of K£RA-like initiatives well before 1990. "Chapter 1 has been a model for us. 
Even before KERA, Chapter 1 was going into classrooms,” explained Fayette’s curriculum director. 

A Christian County principal reported similarly, "Chapter 1 preceded much of what KERA asked us 
to do." Notably, both counties emphasized strong staff development, early childhood education, 
problem-based teaching and learning, outcomes-oriented instruction, and site-based decision making. 
Still, KERA mandates pushed those reforms forward with new resources, technology, staff 
development, family resource and youth services centers, and SBM councils. Tlie KERA ungraded 
primary for students in kindergarten through grade three stresses the same developmentally 
appropriate teaching strategies that Chapter 1 programs were already advocating . 

Christian and Fayette are both developing local cuniculum guides to reflen the academic 
expectations of the state’s curriculum framework. Pending the completion of the local guides, 
projected to take several years, district leaders are using the guidance in Transformations to encourage 
a diversified repenoire of teaching strategies, including favoring trade and theme books over basal 
readers to team reading, increased student writing, and nnatheroatics and writing portfolios. 

The thrust of Cnapter 1 in ChristiiUt County is on in-class support, but the program is 
flexible enough so that classroom teachers can ask Chapter 1 staff to assist small groups of students 
outside the classroom when necessary. In 1994-95, Christian County inaugurated its first Chapter 1 
schoolwide projects. Other examples of Chapter 1 and regular program coordination in Christian 
County are the jointly sponsored county and Chapter 1 adult education program and an aimu?! family 
reading night that drew more than 300 parents in 1994, Chapter 1 hiieU the county’s first tv/o nurses 



’ Christian Couniy Public Schools serve 11.000 students in grades preK-12. 52 percent of whom receive 
free or reduced-price school lunches, and 38 percent of whom are African American. Fayette County Public 
Schools enroll more than 33.000 students; 30 peicem are eligible for free or reduced-price lunches. The student 
population is 76 percent white. 22 percent African American, and 2 percent from various other ethnic groups. 
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to serve Chapter ! schools, inspiring the district to adopt nursing services as a district-funded 
program. 

Fayette’s Chapter 1 teachers also collaborate with regular education teachers, offering 
identified Chapter 1 smdents both in-class assistance and supplemental tutoring. Three schoolwide 
projects began in 1989, and several schools look forward to the eligibility level dropping below 75 
percent poverty (as provided in the 1994 legislation reauthorizing Title I) so that they can qualify. 
Fayette’s Chapter 1 program concentrates its resources on core areas of reading, language arts, and 
mathematics achievement, using an array of components: an extended primary program for IS 
kindergartners at 21 sites; reading and marhematics "advantage" programs offering students whole- 
language reading reinforcement within classrooms; manipulative-based mathematics tutorials; and 
compensatory reading and mathematics for students in centers serving neglected and delinquent 
children. 

Christian and Fayette elementary schools installed computer laboratories with KERA funds, 
expanding throughout the districts the very successful Chapter 1 -piloted Accelerated Reader program, 
a reading program that rewards students for the number and difficulty of high-quality children’s books 
they read. Christian County installed Jostens computer laboratories in each school and staffed them 
with Chapter 1 aides. Fayette’s Chapter 1 also makes computers available to eligible students in 1 1 
of its schools by purchasing software that supports higher-order thinking and writing. 

Coordinating KERA reforms and Chapter I in these districts advanced policies of "inclusion” 
and "coUaboration”-both techniques for strengthening program coordination-that the Chapter 1 
offices had been advocating for some time. The 1992 federal policy modification accepting incidental 
contact of Chapter 1 teachers with non-Chapter 1 smdents finally relaxed remaining local restraints on 
placing programs within classrooms, reflecting the integration of resources KERA had advocated. 



Maryland 



"Schools for Success” is the name of the Maryland reform program that evolved out of the 
1989 report of the Governor’s Commission on School Performance (Maryland State Department of 
Education (MSDE), 1991). The report proposed sweeping recommendations for making 
accountability in Maryland "the fundamental ingredient for reform" (MSDE, 1993b, p. 4). Initiatives 
introduced in 1989 included school improvement through site-based school improvement teams 
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(SITs), early childhood education, a focus on the education of at-risk students, and integrated 
education and family services for students. At the system’s core is an extensive accountability 
structure, including a new perfonnance assessment system and specified cognitive and noncognitive 
criteria that schools must meet. Schools that do not meet the standards by 1996 are expected to face 
restructuring or "reconstitution’’ (MSDE, 1993a). 

The state’s performance program incorporates five elements that structure school 
improvement. They include: (1) providing information to measure school performance; (2) 
establishing performance standarus tliat each school must meet; (3) publishing the Maryland School 
Perfonnance Program Report so communities can monitor schools’ progress toward state standards; 

(4) requiring school-based improvement planning to reform curriculum and instruction; and (5) 
establishing a review system to recognize schools achieving or making exceptional progress toward 
achieving the state standards while levying sanctions on schools whose students fail to meet state 
standards. The implementation details for most components were just being worked out as this study 
was conducted, so we were not able to observe the impact of die new programs. 

Two assessment components that have a several-year implementation history are the 
Maryland School Perfonnance Assessment Program (MSPAP) and the state’s Functional Tests in 
reading, writing, mathematics, and citizenship (MSDE, 1993b). A perfonnance-based test, MSPAP 
is designed to change teaching by measuring school achievement with group and individual learning 
tasks like those that state and national curriculum groups recommend using routinely. Based on die 
Maryland learning outcomes adopted by the State Board of Education in 1990. the MSPAP tests 
critical thinking and problem-solving achievement with applied tasks and practical problems. In 1994, 
the MSPAP was administered for the third year. The Maryland Functional Tests, in existence since 
the mid-1980s, are similarly "aligned’ to the state’s instructional program, but they concentrate on 
assessing the attainment of "basic competencies" (MSDE, 1993c). Students must pass the Functional 
Tests before they can graduate. Previously administered during high school, the Functional Tests are 
being conducted in middle schools for the first time in 1994, and students will retake them annually 
until they pass. 

The Maryland School Performance Report (MSPR) (MSDE, 1993c) is the centerpiece of the 
accountability reporting system. Since 1991, it tracked school and district performance. The 
state agency summarizes countywide data and forwards computerized score reports to the counties for 
distribution to schools and the public. A .state report documents countywide measures of 
achievement, attendance, promotion, high school completion, and postsecondary decisions. Also 
recorded is supporting information about schools and districts, including population characteristics, 
school readiness, the number of students receiving special services, and financial and staffing data. 




Two levels lu. v cen establi-".*d for student performance on the state’s assessment tests, “excellent" 
and "satisfactory." Although the specific criteria for achieving these levels vary by grade and test, 
school pass rates must exceed 90 percent for a satisfactory rating and exceed 95 percent for an 
excellent rating for schools to reach the state standard. The MSPAP standards for smdents were to be 
set during the period in which this study was conducted, but they were not available at the time of 
this report (MSDE, 1993b). 

According to state officials. Chapter 1 influenced Maryland’s accountability-focused reform 
and its strategy for assisting low-performing schools. With its experience in goal setting, school 
improvement through school-site teams, and school-based planning. Chapter 1 served as an example 
for the state’s evolving statewide compensatory education program. Chapter 1 students must achieve 
the same high standards as all other students in Maryland, and the state has begun to use school 
improvement teams to integrate all student services around improvement goals for schools serving 
high-risk populations. The state Chapter I office advocates a folly integrated approach to Chapter 1 , 
requiring LEAs to show how their services enable students to reach the state’s "challeuging 
performance standards expected of all children" (MSDE, 1994, p. 34). It promotes flexibility and 
student responsiveness as the standard for determining how LEAs will meet students’ needs for 
supplementary services, preferring scboolwide and in-class program models. Officials stated that in 
the past Maryland’s strong local control has minimized the impact of the state org;mization on some 
local programs. Nevertheless, during *' e past year, the state superintendent convened a study panel 
on Chapter 1 that recommended aggressively connecting Chapter 1 with state improvement initiatives 
(Grasmick, 1994). The study resulted in a timetable of activities that will coordinate statewide school 
improvement requirements-including planning, assessment, and C’uriculum coordination-with those 
required by the federal Chapter 1 program. 

Feature.s of Chanter 1 in a Maryland District 

We studied Chapter 1 in Frederick County because of its leadership in developing a Chapter 1 
program that is integrated with a well-aligned state and local curriculum and assessment system. The 
district is a Maryland suburban community located about 60 miles from Washington. D.C.* Its 



' Frederick County is the largest in Maryland and comprises a mix of small city, suburban, and rural 
coDununities. In 1992-93, Frederick County schools enrolled 29,297 students. 13.5 percent of whom qualified 
for free or reduced-price lunches. Ninety percent of the students are white. 7 percent are African American, 
and 3 percent are other minorities, mostly Asian immigrants. Chapter I served 986 students. 3.4 percent of the 
total enroUmeiu. 
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challenges are typical of many near-city districts with small Chapter 1 programs; to seamlessly 
coordinate Chapter 1 and regular education so that the program’s small number of students is free of 
stigma or label, and so that the distria meets its obligation to bring achievement levels of all students 
up to the high standards the state has set. 



Frederick sets "essential discipline goals" and course objectives for each grade level. Goals 
and objectives are prescriptive and detailed, specifying precisely the skills smdents are expeaed to 
demonstrate. To measure progress toward the goals, the district in 1989 created the Criterion- 
Referenced Evaluation System (CRES), a locally designed system of criterion-referenced, 
peiformance based assessments measuring students’ mastery of the essential curriculum. The 
assessments are a vehicle for shifting from using letter grades as evidence of success to setting high 
mastery standards on the CRES as the achievement requirement. The local tests are also aligned with 
the MSPAP. 

Teachers use CRES to diagnose student learning problems, to guide instruction, and to 
evaluate student mastery of course objectives. CRES results are annually reported to the public, 
along with information about schools’ achievement on the state Functional Tests and the MSPAP and 
reports of attendance, dropout rates, and Algebra 1 completion rates. The CRES assessments have 
basic skills, multiple-choice, and performance-based components, and emphasize critical thinking, 
problem solving, and communication. 

Local educators regard Chapter I as a tool to use in serving at-risk students. The program is 
smalt, but Frederick’s Chapter 1 is highly integrated with the regular program, even without the 
benefit of a schoolwide projea option. The county concentrates Chapter 1 resources in the early 
childhood years, serving preK-3 smdents, shifting seven years ago from a pull-out program to a team- 
teaching approach. Alter a series of meetings with federal officials, Frederick County clarified 
procedures for using team teaching and a locally designed criterion-referenced test as the basis of 
Chapter 1. The program supports the local "essential" curriculum and uses performance on CRES, 
along with other measures, to select its students. It also sets desired outcomes on the basis of smdent 
mastery of the essential curriculum as measured by CRES. 

In grades 1-3, classes enrolling students eligible for Chapter 1 have two full-time certified 
teachers, and they comprise roughly equal numbers of Chapter 1 and non-Chapter 1 smdents. There 
is no "Chapter 1 teacher" designated to work with low-achieving smdents; both teachers take 
responsibility for working with all smdents in the classroom, giving intensive one-on-one and small- 
group instruction to Chapter I smdents as they need it. To ensure that Chapter 1 serves only eligible 
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students, teachers and supervisors closely track instruction for Chapter 1-identified students through a 
planning and monitoring process called REEM (Reinforce. Extend, Enrich, and Modify) 

Two schools offer a prekindergarten program that is funded jointly by Chapter 1 and Head 
Stan; Chapter 1 pays for the cognitive component of the program by providing a certified early 
childhood teacher, and Head Stan pays for transportation, health, food, social services, and a 
classroom aide. In another Chapter 1 program component, paraprofessionals work as classroom aides 
in mderganen classrooms that enroll Chapter 1 students. Chapter 1 and the local board of education 
also fund a number of fiill-day kindetganen classes for students most at risk, community liaisons in 
each school, activity/book/toy libraries, and Chapter 1 summer school. 



New York 

State Reform 

The most recent reforms in New York expand on die themes of previous ones, including 
innovation in teaching, high standards of achievement for all students, systemic planning and 
accountability, and parent involvement in governance. In 1984, the state's Board of Regents adopted 
an aggressive action plan that established test-based minimum competencies; tougher graduation 
requirements; ambitious academic goals measured by formalized assessments; and annual student, 
school, and district accountability. Despite these substantial efforts, problems persisted. 

in early 1990, the Commissioner of Education and the Regents reached into the community to 
draw up A New Compact for Learning (NCL)-a package of statewide commitments that would 
"reconceive" New York’s educational system (New York State Education Department/University of 
the State of New York, 1992, p. 2). In redefining the state’s strategies for achieving its education 
goals, NCL placed greater emphasis on learner-centered curriculum and assessment and sought to 
establish clearer responsibilities for the many community constituencies involved in education. As in 
other states, the vision of the NCL embraces the assumption that all children can learn. Moreover, 
the NCL plans to make teaching and learning more responsive to students by changing how 
government agencies support children and schools. Two ideas summarize the central themes of the 
NCL. First, there will be “top down support for bottom up reform "-meaning that policy makers and 
teaching professionals will become partners in change; and, second, government agencies and 
communities will together create an environment-become the "whole village"-in which children can 
thrive. 



The N'CL did not change the Regents’ Action Plan of 1984; instead, it established new 
approaches to achieving it. With the blessing of the Commissioner, the Regents, and the state 
legislature, innovative pranitioners took the resources allocated for reform to plan and try out over 
the next several years new ways to achieve the NCL goals. The NCL is not a quick fix; it is a long- 
range commitment that will evolve graduaUy, following the direction of statewide advisory task forces 
and learning from local innovations. A state ol^cial acknowledged that its implementation will take 
"up to the lip of the next century. " The key feature of the New Compact is that districts and schools, 
not the state, will spearhead local changes. The state education agency has been reorganized into 
field services teams to integrate its direct support of local efforts. Advisory committees are 
convening across the state under the auspices of the Commissioner of Education and the Regents to 
draft, propose, and. in some cases, pilot local implementations of NCL goals. State-sponsored 
reforms that districts and schools are trying include; changing the state’s assessment systems; drafting 
new curriculum frameworks in seven fields’ (mathematics, science, and technology; social studies; 
and English/language arts are being completed in 1994); establishing a School (^ality Review 
Initiative to provide the expert assistance of experienced peers for schools committed to improvement; 
revising the process for obtaining variances from certain state regulations; piloting workforce- 
preparation programs; and sponsoring partnerships to help schools implement the New Compact. 

Chapter 1 is one of a number of state and federal instructional support programs that fund 
district-level initiatives on behalf of at-risk smdents in New York, and it is integral to the state’s 
strategy for serving its educationally disadvantaged population. Since 1985. New York’s 
compensatory-education policy has emphasized these elements: (1) programs that are "congruent" 
v/ith regular education, establishing a clear connection between compensatory and regular classroom 
activities; (2) a focus on measuring student success in regulai classrooms; (3) support for building- 
level change, primarily by investing in scbnolwide projects; and (4) accountability-based school 
planning. Especially with the adoption of NCL, Chapter 1 is designed to promote flexibility and to 
ma ximiz e the coordination of districts’ services. As a result, the state strongly encourages the 
adoption of schoolwide Chapter 1 projects and a number of in-dass suategies for coordinating 
resources to maximize the benefit for students. 



’ The seven fields that will have fiameworks are mathematics, science, and technology. English/language 
arts; social studies; languages other than English; arts and humanities; health, physical education, and home 
economics; and technical and occupadonal studies. 



Features of Chanter 1 in New York Districts 



We visited two districts in New York State-Community School District One (CSDl) in New 
York City, and Niagara Falls City School District (NFCSD) in upstate New York.*° Both districts 
have long-standing reputations as inno\ xots. Having benefittcd from innovation in the past, leaders 
in these districts welcomed the message of the NCL. The two districts contrast markedly in the 
stability ot’ their leadership, however. Niagara's top managers and school board members have 
established long tenures with the school system. Many were bom and raised in Niagara and have 
spent most of their careers in the Niagara area. Although schools in CSDl are also staffed by 
veterans who live in or near the district’s lower East Side New York schools, at the time of the study, 
the superintendent and his top staff were relative newcomers, brought into the district in 1990 by a 
"reform” school board.” 

Community -written goals and action plans guide both districts, laying out high expectations 
for student achievement. Since 1990, CSDl followed an action plan known as the Blueprint for 
Progress (updated in 1993) that called for an anay of educational innovations such as: project -based 
and exploratory learning; whole-language reading and language arts; interdisciplinaiy and 
multicultural instruction; and districtwide professional development for all employees, including 
teachers, principals, distria administrators, and clerical staff (CSDl, 1993). In i992. Niagara 
adopted Standards of Excellence for students, defining how graduates will demonstrate ’'proficiency 
and competence” in 14 fields of knowledge: computation, communication, science, literature, 
history, geography, vocabulary, civics/govemment, health, cultures, environment, technology, second 
language, and human resources (NFCSD, 1994). In addition, to meet graduation requirements, 
students must participate in political, economic, and social institutions; demonstrate that they know 



CSDl serves a 97 -percent minority, muidculcural. and muldlinguaJ populauon of 10,323 students 
Seventy percent of the students are Hispanic. 15 percent are African American, 9 percen: are Asian .American, 
and 5 percent are white; 21 percent of the population have limited English prohcieucy. The major languages 
spoken by students include Spanish, Chinese, and Bengali. More than 80 percent of CSDl students live in low- 
income families, and Chapter 1 serves about half of its student enrollment. Of Niagara s 9,000 students. 67 
percent are white, 28 percent are African American, and 5 percent are other minorides, Only 1 percent have 
limited English proficiency. Almost half the NFCSD student populauon is eligible for free or reduced-pnee 
lunches, although only about one>quaner of its students are enrolled in Chapter 1 . 

” By the time we concluded this study, the politics of reform in CSDl had shifted. Another election 
brought a new balance f power on the school board, including a faction chat declined to renew the 
superintendeniVs contract. The sudden shift in leadership meant the third change of superb 'cndents in less than 
five years, leaving uncertain the fate of reforms begun in 1991. Still, according to local sources, the school- 
based initiatives we observed seemed to have sustained the shift in the district’s top managemcm-at least for the 
time being. Principals in the most innovative schools wc visited credit their schools’ stability to parents' 
commitment and to the detenninacion of their administrative teams. 



how to use and care for the environment and natural resources; and practice good habits for physical, 
mental, and emotional health. 

Twelve of the 15 eligible CSDl schools have schoolwide Chapter i projects, and all Chapter 
I programs offer instruction consistent with the state’s core curriculum for all students, including 
reading/langurge arts and mathematics, social studies, science, mathematics, writing, literature, and 
art and music. The district provides the same whole-language curriculum for all children and is 
moving toward heterogeneous grouping. Because 21 percent of CSDl’s students are designated as 
having limited English proficiency. Chapter 1 supports resource teachers and aides who deliver 
instruction in ESL classes and in students’ home languages. The district also has several dual- 
language immersion programs in Spanish and English. In some cases. Chapter 1 funds support early 
childhood programs or reduce class size. 

Niagara educators embrace research-based programs and work in school-based teams to 
identify and bring cutting-^dge strategies to the district. Teams often include parents and business 
leaders who join representatives of the teacher and administrator unions in developing iimovative 
planning and implementation. Potential new programs start as pilots in Niagara and those thought to 
be the best are distributed as program options that sites can adapt to their own purposes. 

None of Niagara’s schools has a sufficiently large concentration of students poor enough to 
make it eligible for a schoolwide project. Nevertheless, the targeted program attempts to make a 
seamless connection between Chapter 1 and regular education for students and teachers alike. ”It is 
our intent,” Niagara’s Chapter I guidelines explain. ”to have [Chapter 1 -funded] curriculum teachers 
follow the district’s curriculum process in assisting classroom teachers to meet the needs of targeted 
students in the content area....” (Niagara Falls Board of Education, n.d., p. 4). This strategy means 
that Niagara’s Chapter 1 services vary in focus depending on the school, the grade, and the particular 
children targeted. 

Services aie available to all eligible children in grades kmderganen through 12. and Chapter 1 
students receive the same basic instruction as their peers who anend regular classes. Those needing 
supplementary assistance receive it through short-term pull-oui activities. An extended day for 
Chapter I kindergartners who are most at risk adds between 45 minutes and 1-1/2 hours a day, with 
up to four specialist teachers collaborating in the same classroom to offer children a language- 
enrichment program and close, personal attention. Teachers monitor students closely to see that they 
”revolve” through Chapter 1, receiving the help they need and then moving out of it as quickly as 
possible. 
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Important features of both Niagara's and CSD 1 ’s approaches to compensatory education are 
their year-long, weekend, after-school, and in-school staff development for all professionals- 
administrators, teachers, and paraprofessionals. Reflecting the prevailing philosophy of both school 
districts, a CSDl principal explained: "Just as we think of building a child’s strength, we need to 
build the same strength in the people and the system." Various external sources of funding help 
leverage Chapter 1 and state compensatory resources to offer extensive, coordinated professional 
development programs for teachers and administrators, as well as parent educariori activities. In both 
districts, the small central office staffs also work closely with Chapter 1 schools to support curriculum 
change and to facilitate the New Compact’s SBM/SDM requirements. 



IV. Cross-Cutting Themes in State and District Reform Implementation 



We discuss here cross-cuttiflg themes of systemic reform in the experiences of the districts 
and schools across the five states we studied The discussion explores the integration of state reform 
and Chapter 1, examinii^ the challenges-especially the unresolved issues-of coordinating state and 
local reform on behalf of disadvantaged students. 

Among th“ districts aod schools we visited, which are somewhat unusual in the degree to 
which tl ey embrace reform, the implemematicn of systemic initiatives is a work in progress. When 
Chapter 1 is organizationally integrated with other services, as it was in the sites we visited, it is a 
well-used resource for increasing services that upgrade the education of disadvantaged students. 
Systemic reforms typically build on the well-trod path of past successful education innovations; and 
they are adapted to local circumstance, taking hold first and most completely where there are teams of 
professionals who can knowledgeably lead the process. Change occurs one school at a time; "it will 
happen community by conununity, not from Washington, aid not from the state." a superintendent 
pushing reform reminded us. 

The experiences of these districts shed light on the factors driving change in the current 
reform envirornnent-especiaily new arrangements for high-stakes assessment-and on the tremendous 
amount of work still to be done to realize the promise of standard-setting and assessments, curriculum 
development, capacity building, and site-based management. 



Standards, Assessment, and Accountability 

From the sites in this study we learned that siandards-driven reform will unfold unevenly 
within and across states and Title I programs and that the variability of programs and implementation 
strategies can be expeaed to raise new complexities for federal Title I policy making. Key issues are; 
standards and performance expectations differing from state to state; the slow pace of implementation; 
major changes in states’ assessment systems; contrasting perspectives on the value of sanctions for 
schools; varying use and limited availability of new assessments for Chapter 1; and tlie paucity of 
information from the new assessments for practical ^ise bv educators. 






What Are the Standards? 

States set many kinds of standards. Task forces and committees typically define the broad 
outlines of what children should know and be able to do in a number of core content areas. Their 
definitions of content and performance standards vary, however. The states set goals in different 
disciplines and at different grades or developmental levels, and the linkages among spates* 
expectations for students are unclear. In the states we visited content standards are often lists of 
goals, outcomes, or skills to be taught and Chapter I has incorporated them into desired outcomes or 
overall program goals. Arizona identified ” Essential S kills " in 11 core content areas; Kentucky and 
Maryland established ** academic expectations" and "learner outcomes" in reading, language aits, 
mathematics, social studies, science, and writing. New York’s draft frameworks are extensive 
descriptions of study areas and lists of competencies and concepts. California alone expands on the 
subject matter of every discipline, including detailed descriptions of the content and thinking required 
to apply each discipline, and strategies for teaching students with varying educational needs. In 
addition, California’s frameworks, unlike the other state content guides, are not just statements of 
content standards but also include performance standards and rubrics agpinst which students' work in 
each discipline can be evaluated. 

The states use similarly various definitions of performance standards, md, except in 
California, they are not well identified with the states curriculum frameworks. California’s six 
performance levels for individual students’ work are illustrated in the frameworks and in other 
supporting documents, including the annual test reports (CDE, I993e^^- Kentucky identifies four 
achievement categories for each subject on the state test-novice, apprentice, proficient, or 
distinguished— but the discipline-specific performance descriptions for each grade are not in the 
curriculum materials (KDE, 1994b). Maryland reports two performance group ings-percent ot 
students achieving either satisfactory or excellent on MSPAP-but the performance levels students 
must achieve to attain these levels are defined by a standatds-setting task force sponsored by tie sute 
board, and are also not explained in the currently available curriculum materials (MDE, 1993c) In 
Arizona, the ASAP offers teachers training in how to help students achieve the essentia^ skills by 
using sample scoring rubrics and tasks modeled on test items. Districts decide target proficiency 
levels locally (ADE, 1993), and neither rubrics nor other performance standards are included in the 
Essential Skills documents. 



See examples of California's performaocc levels in reading/languagc arts, mathematics, and writing in 
Appendix 3. 
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After several years of test development, states have begun to use new tests with open-ended 
items-known as performance tasks or performance-based assessments-in place of multiple choice 
items. It typically takes at least three years for the innovative assessments to be designed and piloted, 
however, and several more years before assessment results are available for individual students. In 
1994, Arizona, California, and Kentucky provided aggregate summary scores from their new tests for 
districts and schools with Chapter 1 students, but Chapter 1 data arrive after a long delay and in a 
format so general that the information cannot be readily used to guide instruction or program 
planning. In a position paper written to propose modifications in the test during its next phase of 
development, KIRIS authors acknowledged both the weak link between performance ind content 
standards and the lack of instnictionally useful information for individual programs. 1994c, 

pp. 10-11): 

The content being assessed is not well enough defined and the relationship among the learning 
goals, academic expectations, the curriculum frameworks, the program of studies, course 
outlines, released items and performance standards is not clearly described. It makes it 
difficult for teachers tu focus their instructional efforts and to explain to parents what content 
is being taught and assessed. . . . Better design and development of other repons to more 
adequately provide information for instructional decision-making are common requests. 

Currently, the performance emphasis in Kentucky is on composite achievement-test scores of 
students in each senool, called "threshold" scores, and, although the state is moving toward reporting 
individual student scores, this had not occurred by spring 1995. Maryland’s satisfactory and excellent 
levels are based on school-by-school and district percentages of students achieving predefined 
standards on several indic« tors of academic standing and school participation (attendance, dropout, 
and retention rates) and Chapter I programs rely on traditional tests or other locally developed 
assessments. New York uses seveial multiple-choice tests and holds students accountable for 
achieving designated "state reference points" on Regents’ examinations. 

ReadingTanguage arts, mathematics, and writing are tested by all five states, but only 
California, Kentucky, and Maryland examine science and social studies with open-ended items or 
performance tasks on their statewide tests. Arizona lets the districts decide what tests and criteria to 
use in measuring science and social studies. New York tests science and mathematics, but, as it 
experiments with new assessment strategies, it plans .o continue using its multiple-choice tests until 
content standards are set in these fields. 





Kentucky and Maryland measure performance in several concent areas^^ through a limited 
number of extended tasks from which separate scores are derived. As a result, it is not evident 
without examining the test itemS“K)iily samples of which are typically made public-how consistent a 
state's content expectations are with "national" standards. Some state officials are concerned about 
whether they have measured the right content or set "reasonable ” standards, and whether their tests 
reveal how close students are to meeting national targets. They explained to us that they continually 
struggle with new issues, asking themselves, "What do we [learn] from the results? .... Did we set 
too high a standard or are we not yet there? What is the right compromise between the reality and 
tie options?" 



A Multiyear Process of Reform 

Across districts in all five states, the advent of new standards and assessments has turned out 
to be a slow and often unstable process, lasting from almost two to six years and changing along the 
way. Curriculum and test development are followed by standard setting, and each component in the 
system is separated by a long lag time between development and classroom use. After almost five 
years, the implementation of standards and assessments is still very much evolving. 

The challenge of implementing California mathematics reforms is well documented 
(Educational Evaluation and Policy Analysis, 1990), and our interviews revealed the same 
implementation challenges in other content areas and in other states as well Even with the rich 
professional development programs, subject mauer projects, ai d other dissemination California has 
undertaken, changes Li classroom practice have been piecemeal. Arizonians worked for more than 
six years to develop a consensus around their Essential Skills, using a process of comminee work, 
public hearings, and distria reviews. Still, according to sute officials, the skills outlines 
"languished" until the planned reporting of results from ASAP became a reality for students and 
teachers. 

The recent political challenges to state reforms are i.idicators of the fragility of the new 
systems. The states have taken from three to five years to move their assessments fron the drawing 
boards through the pilot phases and into the classrooms; New York has set in place ar. even more 



Kennicky's performance "events* also measure achievement of standards in the arts and humanities, 
practical living, and vocador^^ studies. 



For an extensive explanatioD of these and oih^ 
assessment, see Linn (1994). 



y ar ' tixhnical dilemmas of performance 
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gradual time line. California’s and Kentucky’s experiences are case studies of Jie challenges that new 
standards and assessment systems can be expected to confront; both have been required by practical 
and political pressures to modify their curriculum frameworks and their assessment systems as they 
have moved forward. 

California, for example, researched and piloted its conceptual framework for CLAS over the 
ten years that the curriculum frameworks evolved. In addition to the continuing test development 
activity the state agency undertook, the legislature supported a three-year independent research 
initiative, the California Assessment Collaborative (CAC) (CAC, 1993, p. iv) "to amplify the voice of 
teachers in the development of assessments." CAC does this by sponsoring studies and trials of 
performance assessments in classrooms thioughout the state. CAC’s work sets a tone of inquiry and 
experimentation that contributes to statewide capacity building not only by modeling promising 
practices but also by warning about potential pitfalls in site-level development of alternative 
assessments. 

California coupled its assessment with a strong, information-based accouniabiliw system. 
Assessment developers expected the assessment and demographic data and the intormauon about 
students’ classroom and at-home learning experiences would provide the direction California schools 
needed to plan their programs, especially for at-risk students. To dare, the promise has not been 
mlfilled. Since the new assessment system was conceptualized in late 1989 the obstacles to lu? 
usefulness for classrooms and for Chapter 1 accountability have included its cost, the debate about us 
open-ended test items, ard the lack of individual student reports. CLAS and other states’ new 
assessment systems share these problems, and the lack of student- level accountability information is 
particularly problematic for tracking implementation of Title 1. California’s anticipated performance- 
based assessment reports were t xpected to have been among the first and most comprehensive in the 
nation. Even if the legislanire eventually approves frnding to modify and continue CLAS. providing 
student-level scores will require modifying the matrix assessment strategy and reducing the number of 
open-ended items that will be used. 

Kenrucky experienced a similarly rocky evolution of its new performance system Kentuck> 
wrote its original learner outcomes and the curriculum outline guiding local curriculum developmem 
within 18 months after the Kentucky Education Reform Act passed-bui not without stirring 
controversy. Soon after the curriculum guide wr' distributed, a number of the teaching activities 
were dropped or replaced because of their controversial content. Within the year, in summer 1994. 
the state renamed its learner outcomes "academic expectations" and dropped the objectives that refer 
to "habits of mind" and "sefr-sufficiency" --important themes of the original reform. 
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KIRIS was piloted in 1991 and began in 1992 as a three-part asseisment at grades 4, 8, and 
12, that included a "transitional" test with multiple-choice and sbon-answer questions, performance 
tasks, and writing and mathematics portfolios. Results from the test’s cognitive component were 
combined with noncognitive measures such as attendance and graduation rates to produce school and 
district scores on a 140-point accountability index. State lav/ specifies that schools must climb on the 
index by 10 percent every two years to achieve a "threshold score," an improvement goal that is 
individually calculated for each school, but these thresholds w'ill be shifting over time as the tests 
themselves are modified. 

Although the KERA accountability standard of progress toward the threshold score is 
unchanged, modifications to the two-year-old assessment system in 1994 included refining the 
outcomes in response to the concerns of technical review panels and citizens' groups that were 
monitoring program implementation. The changes in KIRIS shifted the mathematics portfolios from 
grade 4 to 5, moved the high school test from grade 12 to grade 11, replaced unstable performance 
events in mathematics and social studies, and dropped the multiple-choice items from the total 
accountability score to include a writing component in the score. Final decisions on these matters 
were pending at the time this study was completed, but officials observed that they expected such 
changes to continue throughout the evolution of this and any other inm vative assessment program 
(KDE, 1994a). 

In an attempt to minimize some of the false starts other states have experienced. New York 
officials are proceeding more slowly. Standards and assessment development began in 1992 with a 
high-level task force of experts, the Curriculum and Assessment Council, appointed by the Board of 
Regents. By spring 1994, the council had drafted and disseminated for comments curriculum 
frameworks in reading/language arts, mathematics, science, and technology, and it had proposed a 
design for the new assessment program. Although the mathematics standards were drafted, officials 
acknowledged that the curriculum development committee had "not yet grappled with what the 
mathematics test will be." however. Committees were just beginning to tackle questions about the 
type of test, the content to test, and the levels of performance students are expected to achieve. 

Based on the experiences of other states. New York is just beginning a lengthy and politically 
tumulmous process. Members of the standards development committee found between their initial 
deliberations and their emerging drafts that they had to rethink their time line and their direction. 

"We don’t want people doing something so quickly and then have it out of sync with the national 
agenda." observed a state coordinator who is working with standards development. 
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Controversy over Sanctions 



Legislators in Arizona, Kentucicy, and Maryland sought to put "teeth" into their reforms by 
using accountability programs that reward success and levy sanctions on repeatedly poor pert'orming 
districts and schools. The proposed sanctions are rauch-discussed-especialiy in schools~but 
procedures for levying sanctions after an adequate period of supportive assistance have not yet been 
put in place. The fairness of sanctions is hotly debated among practitioners, especially in light of the 
instability of the new tests (Linn, 1994), and state administrators insist sanctions will be imposed only 
after a period of self-assessment and opportunities for school improvement assisted by state, local, 
and ou'^side consultants. A Kentucky state supervisor considers her own team as susceptible to 
sanctions as are the schoois, hut still she concentrates on the supportive intent of setting thresholds: 

Teachers need to learn, ‘if our school isn’t meeting the threshold, we need some help.’ 

Failing to meet the threshold means ‘We’re going to get some help,’ We’re all in this 
together. 

Teachers, by contrast, typically feel they have limited control over the outcome of tests, and 
many consider themselves at the mercy of a public that is disregarding their efforts to improve. They 
know they are under pressure to achieve, but they worry that they will not have the time to develop 
the new skills they require to adequately serve their students. One teacher observed: "If we hadn't 
had the sanctions, we would be putting the innovations into place with more training behind us. ’ A 
Kentucky teacher echoed this concern about her lack of preparation: 

We’re accountable for test performance, but I don’t feel comfortable enough with what 1 am 
doing in my classroom to be tested. I’d like to test my own developed ability before the state 
comes in with sanctions on my students. 1 am still learning, and Tm going to be held 
accountable? . . . Even the test developers are learning about the testing. I should not be held 
accountable as the state is developing the test. 

Accountability and assessment are central reform themes in all the states we studied, but only 
Arizona, Kentucky, and Maryland propose to levy sanctions on schools chat repeatedly show poor 
performances, Even in those high-stakes environments, however, the standards are based on 
composite scores students attain on tested components of the curriculum. Arizona, Kentucky, and 
Maryland schools know the average scores their students must attain, but those scores do not translate 
into what it means for individual students to work at "proficient" or "excellent" levels. 

In -"»tes or districts with many limited-English speaking students, some teachers are especially 
disillusioned by sanctions associated with assessment outcomes. Arizona teachers complain about 
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several barriers interfering with students’ success on the ASAPs. Some native Spanish speakers 
maintain that the tests are not written in proper Spanish but are translated from English without 
attenuon to the different underlying language structures. Others argue that the tests deal with topics 
unfamiliar to students; for example, one teacher asked: "What do reservation kids know about 
consumer issues?" and another explained, "We studied armadillos, but the ASAPs went on and on 
about javaiinas. " On the other hand, a more upbeat principal in a Kentucky school district is 
undisturbed by the threat of sanctions that may befall her school, remarking, "We may never make 
the (state’s] goals, we may be in sanctions. But there is a lot more to us than those gains. " 

Accountability standards currently proposed for schools and districts are broader than results 
on a single test; they typically have several components. In Arizona, for example, along with the 
achievement on the new performance-based tests, state and local report cards generally giv'" the 
results of traditional test programs, which are continuing. Although testing is not conducted in every 
grade or subject, most students— including many with disabilities or limited English proficiency— are 
tested, but only on a sample of performance tasks in multiple subjects within a sample of grades. 
Added data elements on the report card include attendance, dropout, and graduation rates, mobility 
rates, special programs participation, and demographic disaggregation of test scores, among other 
data. The sample state accountability reports in Appendix 3 show that die other states include the 
same range and variability of outcome measures, but each state assesses the variables and reports 
them quite differently. 

Even with these wide-ranging measurement points, many district administrators, principals, 
and schools concentrate their critique of their state 's reform on the tests that evaluate schools and 
students, not on the overall school improvement process. A principal expressed his concern this way 

[This is still] a factory model . . . based on flawed assumptions about both the goals and 
processes of learning. Learning is not incremental; the goals will never be fixed. You 
condemn a school based on a single number that mixes cognitive and noncognitive data . . . 
the real examination of children’s progress is to look at both normative and criteria-based 
data. 

Despite the anxiety of school-site personnel over sanctions, state officials prefer to emphasize 
the supportive intent of the standards, not the punitive aspects. Arizona reminds educators that: 

The ASAP is a model for teaching and learning ... the goal ... is to help all students 
achieve at high levels. The combination of high standards and an assessment system to 
measure them provides powerful new tools to teachers and educators to change and improve 
the quality of instruction for all Arizona students (ASDE. 1994, pp. 2-3). 
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Maryland makes a similar claim. According to documents the state distributes, the 
accountability process "offers a road map for moving a plan from conception through implementation 
to continual renewal" (MSDE, 1991, p. D-1). A Maryland state official sees that *he goal is to 
change "classroom by classroom, school by school, kid by kid," and assures skeptics that: 

The MSPAP is only one piece of information. [Together, all the information] takes the 
burden off one school. We are looking at the whole school to look at how kids progress, and 
[we] bring the data all together to make an informed decision. 



Using New Assessments in Chanter 1 

Because state assessment systems are continuing to evolve, their use in Title I evaluation and 
student selection creates a number of practical stumbling blocks. In addition to the gradual process of 
test development and the time it takes to stabilize the tests and test reports, the most innovative, 
performance-based assessments are planned for only a few grade levels and thus cannot be the basis 
for selecting students for targeted programs at other grade levels. As a result, conventional 
assessments continue to be administered in Arizona, Maryland, and New York, both for student 
selection, diagnoses of learning needs, and evaluation: California and Kentucky state offices do not 
administer traditional tests, but many of their LEAs do. 

Moreover, the inconsistency in the standards and differences across curriculums and 
assessments make it unclear how much overlap there is in achievement expectations among the states. 
Because test items are not public, content or item/task difficulty cannot be compared, so there is no 
way of knowing how much commonality there is in states’ expectations for what students should 
"know and be able to do." Even where there is considerable press for accountability-especially in 
Arizona, Kenmcky, and Maryland -states set standards and test in similar content areas, but each state 
selects its own unique content benchmarks. The result is that performance assessments do not 
produce even the rough comparisons and progress markers that traditional standardized tests made 
available for Chapter 1 evaluations. Anticipating the lack of comparability in performance tests, a 
practical superintendent was prepared to strike this balance between the new assessments and 
traditional ones; 

There is no question about [the importance of] using portfolios and performance assessment, 
but I’m not prepared to go to the board without a proposal that includes a nationally normed 
test. Some aspects of kids' assessments could therefore be partly perfomtance and partly 
portfolio. 
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Continuing some elements of traditional assessment systems is one solution all the states 
except California use to gauge progress against a cross-state benchmark. Arizona and Maryland 
administer nationally nonned, multiple-choice tests to a sample of students each year; New York’s 
existing testing system is the foundation of its accountability structure; and Kentucky embeds 
multiple-choice items into its performance assessment system to provide a national benchmark. Until 
1 994, all states except Kentucky used traditional normed-referenced tests for Chapter 1 evaluations . “ 

Using traditional tests during the transition to new assessments is comforting to some, but 
others believe it sends mixed signals. Both a Kentucky coordinator and a principal separately 
volunteered that they doubted whether teachers or parents would ever be satisfied without some 
reference to traditional test scores; "People want to know where their kids stand against a norm,” the 
coordinator argued. Partially in response to this kind of concern, the state accountability office has 
sought ways of creating percentile scores or a proxy for smdent standing on KIRIS (KDE, 1994c). 
Still, state assessment directors are working hard to make the transformation to a new system 
complete as soon as possible. 

Finally, the continuing changes occurring in the new testing systems slow the already long 
time lines for test iiiq)lementation. The hold on funds to support CLAS is a major setback for Title 1 
educators in California who regarded CLAS as a coordinated assessment system consistent with the 
curriculum frameworks. At the end of 1994, Chapter 1 coordinators and teachers waited with 
interest, but with uncertainty, to learn what assessment resources would be available to them in 
forthcoming years. The leaders insist on sustaining well-established accountability expectations and 
on keeping the focus on individual students. Concerned that the most disadvantaged snidents- 
especially the highly mobile and non-English speaking students who are hardest to track-do not "fall 
through the cracks," state and district Title I coordinators are seeking ways to maintain individual 
student accountability during this period of transition to new testirg systems: 

It's a major mistalre if you don’t have a provision for tracking individual students. You need 
to take accountability down to the kid to make sure that services actually go to the kids . . 
accountability protects kids, and it also drives attention to what’s important. ... It goes to 
the heart of everything we do. 



In 1994, the Department of Education granted Kentucky a waiver to translate (he multiple choice 
component of KIRIS into normal curve equivalents for the purposes of Chapter 1 evaluadon (LeTendre. 1993; 
Marsh, 1993). 



A Dearth of Instnictionallv Useful Information from State Tests 



Because the state performance*based tests are new and time consuming to score and report, 
teachers, principals, and Chapter 1 direaors have received little information about them to guide 
Chapter 1 instrucdon or program planning. Although all these states have been developing some 
form of their performance assessments since before 1990, it took until 1992 for Maryland and 
Kentucky to establish a baseline assessment year; Arizona and California established 1993 as the 
baseline year. The test data schools receive are typically six months to one year old and not in an 
instructionaily relevant format. None of the state, district, or school Chapter 1 coordinators we 
talked with h^ been able to ^ply performance assessment data to program planning, so they continue 
to use item analyses they receive from traditional standardized tests and, occasionally, from writing 
samples. They refer queries about assessment results to assessment departments whose staff are so 
busy with development and implementation that they are rarely able to provide detail about Chapter 1 
students or programs, except to meet the requirements of mandated federal reporting. 

Data reports can be obtained from performance assessments, often in draft form, from state or 
district offices, but the information is either too general for instrucdonal use or too specific and 
extensive to be understood by users without special training. "We gather ail this data,* explained a 
Chapter 1 leader, shaking his head ruefully, but "assessment is very complicated. . . . The challenge 
is using the resources provided by the test, the data gathering process. They gather ail this data, but 
it is very difficult to find the time to learn to use it. " This theme was echoed within each state’s 
Chapter 1 office, among local Chapter 1 coordinators, and by teachers. However, the problem is not 
insurmountable. Assessment divisions are responding by hiring new staff, providing increasing 
training, and creating public information materials for numerous audiences. But the investment of 
time and dollars repeatedly outstrips even the most costly predictions of program planners. 

Chapter 1 leaders are cautious about abruptly changing accountability standards or practices, 
concerned about the vacuum created when there are no common, well-deiined evaluation standards. 
Some long'time Ch^ter 1 practitioners fear that the future Title I focus on categories of sradents- 
ethnic groups, SES levels, or students with special education needs— rather than on individuals will 
diffuse attention away from the most disadvantaged children. One state coordinator spoke strongly 
about maintaming the existing arrangements for accountability in Chapter I until new, proven 
methods are found. In this coordinator’s experience, individual student accountability is the only way 
j ensure that the services actually go where they are most needed: 

Lots of principals want to make scores look good. . . . It’s easy to design a program that 

would work with kids who do not need services the most .... We’re not dealing with a 
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Curriculum Frameworks and Curriculum 

Formats and Purposes of Frameworks Vary 

Except in California, comprehensive curriculum frameworks reflecting content standards and 
modeling teaching practice are not available in 1994. All states have disseminated various guidance 
documents that outline achievement expectations, but the documents are inconsistent in depth and 
breadth. Curriculum frameworks are in draft form in Maryland and New York, and difficult to 
obtain. Arizona's 11 different "Essential Skills" booklets include limited information about pedagogy. 
Kentucky’s framework is a 250-page, flexible loose-leaf notebook of instructional tasks that districts 
may use in developing their own local curriculum frameworks. The notebook is highly praised by 
teachers who consider it very "practical; it gives me something ! can use tomorrow." Outside 
reviewers have criticized it, however, charging that its size is "overwhelming" and that it lacks an 
overall conceptual construct to guide its use. Thus, curriculum documents greatly vary in format, 
purpose, and standard, and, despite their substantive depth, they must endure close scrutiny by 
competing politicJ, social, and educational interests. Furthermore, obtaining the consensus needed 
for state adoption means the curriculum writing process takes far longer to complete than teachers can 
wait before needing them to meet accounubility standards. 

After curriculum guidelines are written they are unevenly used, at least until some inducement 
like a high-stakes test is introduced, as in Arizona, Kentucky, and Marylai^d. Furthermore, the 
documents are not quality standards; they do not have the content richness of the Mathematics 
Curriculum and Evaluation Standards by National Council of Teachers of Mathematics or the 
California frameworks. Few state curriculum guides are philosophically and instnictionally grounded. 
Instead, they are brief, practical resources that give classroom teachers, principals, and staff 
developers "tricks of the trade" for preparing students to leara problem solving in the content areas ot 
the new assessments. 

Furthermore, in their current form, most curriculums are incomplete. Their limited 
suggestions, without pedagogical context, minimize the quality of content that all but the very best 
trained teachers can offer. They are samples of content, pedagogy, and standards, not integrated 
discussions, and examples and models of practice are limited. Those teachers new to the teaching 
promoted by these curriculum frameworks and learner outcomes are left to their own devices for 
learning how to use the new content materials, with periodic participation in evening or weekend staff 
development supplements The challenge of putting flesh on the bones of the curriculum frameworks 
falls to district-level curriculum conunittees where writing is slow and expertise is limited. A 
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concerned New York associate state superintendent responsible for training districts to implement 
reform is alarmed by the lack of knowledgeable curriculum expertise in schools and districts: 

A real challenge for changing the quality of teaching and learning is the lack of curriculum 
experts within districts and schools. WeYe finding these 90-day wonders can't otfer the 
curriculum content. We’ll have some problems getting the content and we are working on 
meeting that need. 



California Frameworks Are Unioue 

Only California has instituted a lengthy, field-tested curriculum development process that 
includes awareness building, needs assessment, planning, resource ' eleaion, and four or five years of 
implementation. As a result, state curriculum frameworks are cenL J to Chapter I program planning 
in Hayward and Long Beach. '’Curriculum frameworks are like the Bible," a Hayward administrator 
reported. "We order frameworks for all staff," including, in addition to teachers, curriculum council 
representatives, librarians, and high school department heads, who also routinely participate in 
framework-based in-service programs. Administrators and many teachers we spoke with are 
proponents of the frameworks. The frameworks appear to structure teachers’ practice even when they 
do not acknowledge the frameworks as their key resource. We learned from our observations that 
teaching changed as a result of a combination of interlocking resources, of which the frameworks are 
but one important piece; just as significant were time, the added training, and the collaboration 
teachers experienced over the many years since the first frameworks were available. 

If California’s experience can be considered a model, it takes almost ten years from stan to 
finish for a curriculum change to evolve, and it takes still more time and initiative to see a new 
curriculum used in classrooms. The early 1980s paved the way intellectually for new concepts, 
philosophies, and methods. It took two to three years for committees to convene and develop 
documents, and then to disseminate them for proposed revisions. Several years later, the curriculum 
was being disseminated widely but still used unevenly. Within eight years, the curriculums are ready 
for a new revision and the process brings about more conceptual changes, 



Frameworks and Chapter 1 

To the extent that districts have embraced the new frameworks and are using them to redesign 
the local curriculum. Chapter 1 students also benefit from the revised content outlines. However, 
many teachers of Chapter 1 students hold on to traditional reading and mathematics teaching 
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practices; it will take time for many of them to adopt more active teaching methods and use practical 
teaching strategies that national professional groups recommend. Curriculum frameworks, even 
supported by routine staff development, do not dislodge old assumptions about teaching and content. 
Administrators and lead teachers lament that teachers do not know how to adapt to the new 
responsibilities required of them in today's schools, and their skills as curriculum developers are 
weak. "My teachers don't know how' to make tests; they don’t know how to write curriculum; 
teachers need assistance," a principal explained. Redefining curriculums and packaging them 
attractively is only the first step toward altering what teachers teach. Teachers of Title I students 
require the same retraining and time to practice as other teach;;i5 v/ho are relearning to teach with 
quite different tools and toward new expectations. 



Capacity Building 

New Challenges to State and Local Agencies 

Preparing to teach new, high-standard curriculums to an increasingly diverse studeni 
population places very different demands on educators and on systems. Until recently, retooling 
professional educators was the responsibility of the individual professional who was looking for 
advancement. Today, it is clear the systemically integrated school must continually re-educate its 
entire staff. 

States and LEAs are planning various approaches to extending their orgar.izational and 
technical expertise-building their capacity-to implement reform. Schools and districts adopt new 
mechanisms for staff development to strengthen their available talent pool: mentors, networks, 
collaborations, institutes, and teaching partnerships. The difficulties are great, as education agencies 
try to deliver many kinds of help more effectively and teachers begin what will be. at best, a lengthy 
learning process. State administrators are well aware that teachers need to revise their teaching to 
meet the requirements of their reforms. As one explained, these are not "add-on" programs: 

Teachers need to change their whole teaching approach. It is not good enough that students 
give us the right answer. Teachers were not taught to teach with the whole answer and its 
understanding in mind .... Teachers have had a hard time grauDing on to the concepts 
. [Theyl need to ask what [more] they need to do and how [well] they are doing. It‘s going 
to take a lot of lime. 
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State and local Chapter 1 officials find themselves offering "hand holding and suppon. along 
with vision to districts and schools, not just to Chapter 1 programs.” Teachers maintain that before 
the new assessment systems and the reforms were in place ”we knew what we needed to do, and we 
were successful; [now] we don't understand” the expectations or the new processes. It takes new 
approaches to overcome teachers' uncertainty about what is additionally expected of them. To meet 
the demand, Maryland is planning a video-based instructional system to distribute with its outcomes 
documents; school improvement teams are assigned to specific schools to help teachers learn to use 
available data to reframe programs. Arizona and Kentucky work with districts to help write 
curriculums locally, and, as resources and staff are available, they develop state-level curriculum 
supplements. 

New York’s state agency is organizing interdepartmental teams to assist districts, but this is a 
struggle-learning to "walk and talk” the same strategy The reorganization has thrown confusion into 
the system. Although the philosophy of support has been adopted by the department, the 
decentralization duplicates effort and leaves districts and schools unsure of where to find the 
specialized assistance they need. Top staff in the state department acknowledge this Axhilles’ heel of 
reform. The field service teams are not working, argued a state leader; "They are not working 
because they don’t have the skills on the leam-we don’t have the content people we need.” even with 
the extensive training and preparation the state tries to offer. 

In California capacity building became the centerpiece of reform beginning in the mid-1980s 
with the stale’s investment in high-quality curriculum frameworks and extensive dissemination. The 
state seeks consensus around framework-based instruction and develops teachers’ ability to use the 
framework in classrooms through a highly public development process and a multi-tiered 
dissemination strategy. The frameworks have been developed over the past ten years by committees 
staffed by California’s and national subject matter experts, including scholars, teachers, and 
curriculum specialists (Guthrie et al., 1993), and Chapter 1 has panicipated in development. Before 
adoption, draft frameworks are distributed publicly and tested in classrooms serving Chapter I 
students. Public reactions and practitioners’ recommendations-including those of Chapter 1 parents - 
are incorporated into each final edition of the frameworks. 

In Arizona, California, and Kentucky, state and local Chapter 1 specialists, chosen for their 
prior accomplishments initiating and maintaining local improvement efforts, conduct staff 
development for entire schools and districts. Chanter 1 in all three states carefully coordinates its 
continuing professional development with the goals and tools of the states’ reforms. On-site training 
introduces local educators to processes for developing students’ reading, writing, and mathematics 
abilities with integrated and thematic insnuction, higher-order thinking, and applied skill and 




knowledge development. In Arizona, because no new state funds were available to schools and 
districts for learning to use the EsserAial Skills documents in preparation for the ASAP, Chapter I's 
willingness to offer staff development workshops on instruc^-^ual assessment was welcome. 

California Chapter 1 hosts regional institutes and funds Icv.al educators to attend staff development 
activities associated with frameworks implementation and other statewide reforms. Kentucky Chapter 
1 teachers lead local and regional professional courses for which all teachers can earn credit toward 
salary advancement. 



Relearning in Districts and Schools 

Curriculum-based staff development that uses the frameworks and engages all players in the 
schools, from new teachers through seasoned principals, builds capacity for using curriculum and 
assessment innovations. "We’re always gearing our staff for staff development; they don’t have a 
chance to get bored/ a principal of a Chapter I school told interviewers. In one school district. 
Chapter 1 teachers have eight planning days a year and 50-minute preparation periods each day 
scheduled simultaneously so that staffs can work together. Other districts make similar arrangements 
for collaborative practitioner-led capacity building that unite Chapter and regular education staff . We 
visited schools whose principals and teachers independently seek the resources they need to pay for 
staff development, often piecing together several external funding sources and business partnerships 
with Chapter I funds to ensure their entire staff have the same training opportunities. 

The schools and districts included in this study reach broadly for resources, and they first turn 
for help to their most talented staff members. They also call on these capacity building resources: 

• Federally funded Technical Assistance Centers, Rural Technical Assistance Centers, 
and regional educational laboratories. The selection of a particular source of 
assistance depends on geographic proximity and the relationships that have developed 
over time. 

• State-funded regional centers through which reform activities are disseminated 

« Nearby universities that develop programs, lend assistance, and offer teacher 
education 

• Internal research offices that provide and interpret data for needs assessment, 
planning, and accountability. Some of these offices are large enough to conduct 
studies to determine effective programs or strategies for their community. 
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Teachers use widely varying teaching styles in the schools we visited, and reform initiatives 
will further expand the range before narrowing it. New curriculums without adequate retraining, 
mentoring, and in-classroom critiques will change practice unevenly, if at all. Sometimes Chapter 1 
teachers are "sold” on an approach, but they cannot persuade the regular classroom teachers to adopt 
the innovations. The result is a cacophony of strategies for organizing teaching and using some of the 
popular approaches promoted for teaching students at risk, such as cooperative learning, hands-on 
leainmg, writing- and language-based cross-disciplinary learning, culturally responsive activities, and 
alternative assessment. Some teachers applaud the emphasis on problem- and student-centered 
teaching; others are dubious or do not accept the changes as appropriate. Even some of those who 
espouse reform principles in meetings or in faculty room discussions continue to rely on conventional 
instruction in their own classrooms. 

Without the impetus of a coordinated school or district initiative, change in the practices of 
most teachers continue to occur slowly. Although the districts’ innovations reflect the concepts and 
ideals of nadonaJ standards, they are generally program focused, not specific to the state or local 
curriculum framework. Reading Recovery, Early Literacy Inservice Courses, manipulative-based 
mathematics-among the more popular teacher development programs-have their own preferred 
curriculums and instructional outlines. The staff developers teach from those texts and rarely, if at 
all, reference the slate or national curriculum resources. Finally, connecting standards, local 
programs, and innovations takes time. In two districts in different states, the comprehensive 
literature-based programs they adopted will take several years to be fully incorporated into 
classrooms. By that time, natural attrition and new trends wi*l require additional retraining. 

In many of the sites we visited. Chapter I teachers are the nnovators and experts who are 
leading change. However, there are also many other sites whose Chancer 1 teachers are not so well 
prepared or so highly regarded. Most teachers have attended numerous workshops on learning styles, 
whole-langua^^e instruction, and using manipulatives to ground mathematics learning, but their 
instruction did not give them the time to develop personal knowledge of the theory or the principles 
nor to accept the concepts as their own. District leaders serving small towns and rural communities 
find few specialists available to make a sufficiently intensive commitment; they need experts who can 
stay on site in remote schools and communities and offer the practical teaching expertise and content 
knowledge teachers need to interpret some of the strategies recommended for Title I students. A 
number of state and local supervisors noted that the significant challenge is to "bridge the gap in 
content knowledge partly caused by lack of continuing education (among teachers] and partly by the 
absence of content specialists. " 




Without more time to grapple with the practicalities of new ways of working, many local 
leaders and teachers are using new buzzwords but not necessarily making changes. Indeed, the 
popular slogans of reform ntay simultaneously mask dissent (Who would publitiy disagree with ihe 
proposition that "all children can learn?") while deepening the discouragement or skepticism of 
ttachers who believe their own experience coniradicts the slogans. Seeing the distance benveen 
today’s performance and the reform goals causes cognitive dissonance for teac'^ers of the most at-risk 
students. When we probed the concepts behind stardards with many teachers, they shifted the 
discussion to more concrete, immediate, and incremental goals-progressing to the next book, passing 
a quiz, or achieving the state’s minimuin standard on a competency test; bringing mothers or fathers 
into the school; helping students negotiate around the violence in the streets or at home. 



Although it is clear that capacity building has a long way to go, there are districts where 
Chapter 1 stands out as a vital resource. State Chapter 1 directors encourage districts to use Chapter 
1 to stimulate innovation. Some Chapter 1 schools routinely experiment with innovations and readily 
adopt research-based pilot programs. A district staff development director who relies on the 
professional leadership of his Ch^ter 1 personnel says. "We pick the best for Chapter 1 
Becoming a Chapter 1 teacher means teaching to small groups of students, serving as a mentor and 
professional advisor to colleagues, and attending or conducting professional development on leading 
reform efforts. Resources are readily available, and they are often tlte newest and best in the school. 
In a comment typical of these districts, a central-office staff member observed; 

(Chapter 1] teachers are respected for their hard worK. They are a collegial group. 

Resources and materials are plentuul. Staff development occurs regularly, and it is state of 
the art. The program has the autonomy to seek and find the most informed, supportive 
strategies to address the changing educational and learning needs of children. 

One district we visited. Niagara, allocated sizeable district and Chapter 1 resources behind 
curriculum and assessment development while simultaneou.sly retraining its entire staff-central-office 
personnel and school principals, as well as teachers-to change the style of teaching across the grades. 
Niagara has adopted a cyclical atrriculum-deveiopment process that will gradually move schools into 
language-based and interdisciplinary teaching m all content areas. Curriculum revision in Niagara is 
accompanied by districtwide investment in comprehensive staff retraining based on a new cognitively 
based process for teaching in all subjects and grades (Turbill, Butler, Camboume, & Langton, 1993). 
Chapter 1 lead teachers direct an in-depth course of studies for both faculty and administrators, 
leaching them to capitalize on children’s natural language and thinking abilities throughout the school 



day. Coordinated with the trainLig is a districtwide plan to shift its reading and language arts 
instruction entirely to a literature-focused program that relies on student writing and libraries of 
tradebooks in every classroom. 

Such a comprehensive capacity building effort is the goal in most of the districts we visited, 
and most have within-district teacher development programs that are taught by Chapter 1 teachers or 
by those with prior Chapter 1 experience. The programs offer in-service events and within-class 
modeling. Chapter 1 supervision focuses more on teaching and learning than on regulatory 
compliance. An example is the Chapter 1 program in Faye^u. County, Kentucky, that is closely 
monitored by three teaching specialists. They visit every Chapter 1 teacher each month, review their 
work with students, and conduct monthly meetings that feature training components contributed by 
teachers using new or particulariy successful techniques. 



Site-Based Management and Commnnity Involvement 

Site-based management (SBM) has been widely used in California for many years; Arizona 
and Maryland encourage community involvement, business partnerships, and school-based planning- 
especially to design local school improvements in schools with large numbers of students at risk. 
Maryland provides ’’Challenge Grams" that give school-controlled resources to low-performing 
schools to convene community-based school improvement teams (SITs) and to develop school 
improvement plans. At the end of its second year, the jury is still out on the success of this process, 
however. Although all the states in this study invest in strategies that encourage local control over 
educational decisions and, sometimes, over budgets, SBM is not the reform priority for all schools in 
California, Arizona, and Maryland that it is in Kentucky and New York. 

In Kentucky and New York, SBM is an explicit legislative priority. In both states, SBM was 
incorporated into the legislation authorizing other education reforms, and the strategy was to be in 
place in all schools by 1994. Kentucky’s commitment to school-based decision making is backed by a 
new division within the state agency whose staff are experienced community organizers and group 
process trainers who enthusiastically encourage the initiatives of school councils. A top Kentucky 
official summarized the state’s position: 

The accomplishment is to get people focused on strategies and planning that attend to 
where students are. We are tempted to over-regulate. Lots of uncertain issues are 
raised. What is done when councils want to do something different from the rules, 
which happens all the time? I am cautious about judging the decisions of school 



councils. Let*s give them latitude . . . training is really key. [if we) don’t narrow 
the roads they can travel, they will make very good decisions. 

Niagara's superintendent, determined to steer all his schools successfully through SBM, 
shared the same concern. He and his management team seek to provide enough guidance so that the 
teams do not fail but that there is not so much direction that the proceSsS becomes "top down." There 
are two pitfalls he tries to avoid-"over steering and over restricting. " He fully expects the process 
will be cumbersome and require substantial backing from management; nevertheless, solutions must 
be local, he insists. "There’s nothing wrong with problems," the superintendent observed, "it is how 
you handle them . . . [and] some people need to learn the hard way." 

New York’s NCL is backed by two legislated initiatives attempting to push the process of 
change from the state into the school community: school-based planning and shared decision making 
(SBP/SDM), and revised procedures for schools and districts to seek and obtain variances from 
existing elementary and secondary school requirements. The philosophic commitment behind New 
York’s Compact is to call on advocacy groups and community representatives to rethink and redefine 
what schools will become. According to Commissioner Thomas Sobol (1993, p. 6), ’there cannot be 
local initiative unless all the players are coUaboratively and significantly involved." As a result, the 
NCL agenda specifies responsibilities for state agencies, students, parents, teachers, suppon staff, 
principals, superintendents, school boards, school districts, the community, higher education, and the 
state’s cultural institutions. It places representatives of these groups on committees that will revise 
state and local policies to bring them in line with the goals of NCL. 

Both Kentucky and New York have focused on a strategy of information dissemination and 
consensus building to promote aggressive changes statewide. Both visions rest on the assumption that 
all children are natural learners, and they expect that schools and their communiiies-not the state 
agencies-will bring about change. A top New York state administrator who goes into troubled 
districts to mediate and smooth disr tes associated with implementing the NCL reform sees the 
challenge this '^ay: 

This reform goes to the entire society . . . nothing stands alone; no effort is a sing*;: effon; it 
is always a group of people. Parents and the wider community are inextricable parts of this 
endeavor. We say we cannot do it without you, the c'^ramunity. The concept of the village 
educating the child is very much what the commissioner envisions. 

The same trouble shooter describes his work as "educational espionage," explaining, "1 teach 
parents to ask for the [evaluation] and audit reports, study them, and learn what makes districts tick 
financially." These resources, he maintains, are the tools parents and communities have to help the 





schools implement on behalf of their children. In his view, when the state’s two task forces-the 
Curriculum and Assessment Council and the Parent Partnership Advisory Council-finish their work, 
they will shift the current balance of policy planning power from the state to local districts and 
schools. One of his colleagues is more cautious about the uncertainties that lie ahead, however: ”We 
are still playing with a group of theories/ he reflected bluntly. "We don’t know in today’s economic 
milieu how to get the community to come together around schools.” 



Uneven Results of Site-based Management 

In New York City’s CSDl, we found a district that has been implementing SBM for several 
years and has integrated schoolwide Chapter 1 programs into the process. Schools are autonomous, 
with each one defining its own agenda. In one, we saw very different sides of the SBM experience. 

A committed parent told us that after years of frustration with the school, she learned to work with 
the site’s planning team. She now proudly reports that "everything we do is through consensus. 

When it started, we got resistance. I said, ‘We can do it’. It took time, but people came along. ” A 
30-year veteran in the school agreed that site management has had beneficial effects, reporting: 

"SBM has certainly unified us. Everyone is committed to the whole." In the same school, however, 
others report that the price of the process is uncertainty. The team leader of a school within the 
school, an executive on a multiyear loan from one of the school’s business partners, explained: "It’s 
not so much a school as it is a search for a solution, ” 

In fact, SBM was among the issues that eventually lost the board's support of the 
superintendent in this district. The teachers’ union was never satisfied with the membership the board 
proposed for site-based school planning committees and challenged the district’s implementation of the 
SBM regulation. In the end, the debate over faaional control of SBM by particular political, racial, 
and religious groups within the district caused the superintendent to lose his contract with the board. 

Although New York provides our most dramatic evidence of the workings of SBM and 
community involvement, we found examples in other states as well. In some California schools, the 
inexperience of parents as educational planners was evident: bringing them into the picture without 
appropriate team building or skill development led to frustration for all concerned. In Kentucky, 
parents on the school site council for one school were leaning toward changing the staffing of die 
Chapter I program, replacing certified teachers with paraprofessionals in an effort to serve more 
students. These experiences illustrate the pitfalls of a commitment to broadening the base for decision 
making. 
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Local Context for Implementing Systemic Reforms 

Across the board, the coordination of Chapter 1 and state reforms has proven to depend on 
important features of the local context, especially stability of leadership, available resources, and 
collaborations stemming the deteriorating social conditions that are part of many poor children’s daily 
lives. Where Chapter 1 had been integrated with other state and local changes, there were strong 
leadership and staff continuity for many years-as much as a decade or more. The changes we have 
described are not systemic until they are rooted deeply in a system’s organizational and management 
structure. Even with the emphasis on structural elements like curriculums and assessments, change is 
not systemic if it merely carries the banners and rides the bandwagons of its leading articulators. 
Reforms that are the product of new administrations or that are generated from the top of the 
organizaticn-at the behest of a new state or federal mandate, school board, or superintendent-are 
vulnerable to shifting political winds threatening to topple them. 

The dramatic effect of a leader-driven reform was the rapid departure of the energetic reform 
leader in New York’s CSDl. When the interviews for this study were organized, reform in CSDl 
appeared to have a well-developed and solid foundation, with an investment in capacity building and 
site-based planning and management. Site visitors learned about "new" schools flourishing 
throughout the district with strong signs of cognitively based, active teaching and learning. We saw 
minutes of SBM meetings and talked with enthusiastic parents and teachers. At a school board 
meeting held the evening after we completed our interviews, however, the superintendent’s contract 
was not renewed. Two months later, principals carried on their site-based visions, but we were 
unable to find top leaders responsible for the system-based curriculum and organizational reforms. 
Even the Chapter 1 coordinator-who had been in the district longer than the superintendent and 
believed deeply in the initiatives-bad moved on to a similar position in a nearby district. 

At the same time that state sponsorship supports the development phases of systemic reforms, 
we found that state agencies are weighted down by both human and material resource limitations that 
fiscal crises place on them. Priority program components compete for linodted resources, talent is 
spread thin, yet all components are necessary to sustain the progress initiated. State and local leaders 
doubt that the fiscal support for schools is strong enough to continue what has begun. Even within 
the leading reform states, when local leaders speak candidly, they are concerned most about finding 
and keeping the resources and the levels of personal energy reform requires. They look to new 
flexibilities built into the new Title I as one source of support, but they are also concerned that other 
expectations-targeting of resources, new expectations for student performance, changes in teaching- 
will reduce their anticipated independence. 
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By many standards, the communities we studied have successftiUy kept pace with the 
evolution of education practice, and they have established records of achievement. Nevertheless, 
district leaders are sobered by how difficult it continues to be to adequately serve poor and minority 
smdents. Although many applaud new, higher expectations for students, they know that standards 
setting will not change the capacity of systems to serve the hard-to-reach students. We were told: 
"The issue is not world-class standards. Kids know there are no jobs. We’re playing around. We 
need to show kids the relationship between jobs and the work that they will do." 

Staff stability and expertise are not always strong enough to halt a downward spiral of social 
change; the schools serving the largest proportions of students in poverty face new challenges 
routinely, and conditions often worsen before they improve. Communities and schools are 
increasingly poor, as are students’ families; health needs are more complex than they have ever been; 
and children are threatened by physical danger, either from violence on the street or at home. 

Schools are serving larger numbers of students with little or no proficiency in English. Too many 
students’ families move frequently and, at times, are homeless. A successful Chapter 1 principal with 
a long history of accomplishment with students at risk lamented, "This is no day in the park." He 
and his staff-reflecting the concerns of many with whom we spoke-often feel overcome by the odds 
against the.ir students. Their lest continuing efforts routinely fall shon of the goals they set. His 
words were echoed wherever we went. 

In summary, our examination of the local context for linking Chapter 1 with other systemic 
school improvements indicated that reforms are taking hold in small pockets and benefiting from the 
imaginative combinations of resources local leaders successfully muster. They involve these 
predictable but fundamental features: 

• Widespread ownership of change coupled with institutional arrangemeiits that nurture 
local initiatives through hard times as well as good ones 

• Building reforms on a foundation of research and demonstrated past successes, 
especially on studies of successful strategies for serving disadvantaged students 

• Emphasis on a few core strategies, connected with clear goals, time lines, and 
feedback cycles, and the time for reforms to take hold 

• Coordinating all programs for disadvantaged students-whether through targeted or 
schoolwide approaches— so that they benefit from new standards, curriculums. 
assessments, and accountability reporting 

• Stabilizing the organizational and management structures at ail organizational levels, 
from the superintendent’s office to schools, classrooms, and communities 
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V, Insights for Title I Implementation 



Title I policy under the reauthorized Elementary and Secondary Education Act will help frame 
the practices of schools and districts during a period of transition. The new law addresses the policy 
concern that Chapter 1 requirements may have inadvertently lowered the academic expectations for 
participating students and diminished their access to a challenging curriculum. In place of the old 
requirements are new ones, designed to encourage arrangements that give disadvantaged children the 
benefits of new standards, assessments, curriculum frameworks, and professional development within 
the overall framework of the plans that most st?*tes will carry out under Goals 2000. Nevertheless, 
much work remains to be done in tr*mslating this Title I legal framework into useful guidance for 
districts and schools undergoing the transition that we observed in these sites, where relatively new 
state policies are shaping educational services. In this section, we identify implications of our 
findings for federal policy. 

The experiences of these sites, which show exceptional commitment to reform, can offer 
insights for federal policy if we are clear about what they do and do not typify. First, it is imponant 
to repeat that these districts and schools have not had to be prodded into action by mandates from 
above; leaders in these districts often view new mandates as opportunities to move ahead more 
vigorously with their existing agendas for improvement. Therefore, this study can offer no insight 
into the effects of mandates on districts and .schools reluctant to change their ways. 

On the other hand, these sites-probably representing a best-case scenario for reform and the 
integration of Title \ into reform-permit us to draw inferences about what may happen as the 
implementation of Goals 2000 and Title I proceeds. The experiences of these sites do provide a 
window into the slow evolution of change, the confusion it often brings, and the policies that can 
help. We begin our list of conclusions, accordingly, with the caution that policy makers should not 
assume too much about the progress of announced reforms: 

• Change takes time. The fact that this is a cliche does not make it untrue or 
unimportant, especially where the need for change compete with the need for 
stability. Policy makers should not expect change to occur quickly and snould nor 
judge the effects of reform too early. 

• Reformers should look for every opportunity to emphasize continuity with existing 
professional and policy movements. In these sites, the cumulative effects of many 
years of innovation in Chapter 1 were evident in the classrooms. Reformers who 
trumpet a clean break with yesterday’s ideas are depriving teachers and administrators 
of the opportunity to build on their professional accomplishments. 



The transition to new forms of assessment poses opportunities and problems. In the sites we 
visited, student assessment is a high-visibility arena for reform-and, therefore, a focal point for 
confusion. Standards and measurement approaches are hotly disputed and likely to remain so for 
years to come; and even new assessments only partially measure states’ ambitious new standards 
Chapter 1 has successfully developed an accountability orientation among many of its professional 
staff. Teachers applaud the shift away from irrelevant, traditional tests to assessments that will better 
serve Chapter 1 students, but managers want to retain clear progress markers and accountability 
requirements. The slow development and application of new assessment instruments and their 
ambigijous linkage to either content or performance standards have left those who serve Title I 
students to fall back on traditional tests to meet accountability expectations. Teachers view wicJi 
alann the prospect of being held accountable for new assessments that they do not understand. The 
mixed signals are harmftil, and policy makers should work to reconcile them. 



To alleviai some of the confusion. Title I will have to offer clear requirements for 
accountability; to accommodate rapid change in the state of the assessment an, it will 
have to offer flexibility 

The new assessment methods hold great promise, but during a period of transition, 
they will need to be complemented by some traditional strategies for student selection 
and program planning until the new assessments are piloted and proven effective 

In the transition period, there is a tremendous need for funding to support the 
development of new insOTTients and to bolster local capacity in using them; policy 
makers will have to deten^one the ground rules by which Tide I can legitimately fund 
development and assistance this area without providing general aid to state and 
local education agencies 

To max-mize the usefulness of new assessment systems, technical assistance in 
interpreUiig and using test results is gready needed; teachers also need substantively 
sound resource materials with new curricuJums and teaching practices if they are to 
capitalize on the broader range of assessment results becoming available for Tide I 
students 



Curriculum and capacity building, like assessment, reflect uneven and halting progress in 
these districts because moving the entfre school program forward in a way that benefits low-achieving 
students is no small challenge. Tide [ represents a potentialiy significant resource in meeting the 
challenge, especially because Tide 1 staff members are often local professional leaders who have 
much to offer their colleagues. Curriculum development is an area where there are too few experts, 
especially in schools serving disadvantaged students, either to guide curriculum writing or to interpret 
new curriculum concepts to those teaching at-risk youth. And even districts such as these-with 
histories of leadership in reform-experience a tremendous need for capacity building connected to the 



central themes of reform. The creative use of multiple resources for professional development, while 
admirable in many ways, can leave teachers with a collection of new slogans from several packaged 
instructional programs rather than what they need more, which is depth of skill and understanding- 
The reauthorized Title I provides a mandate to build constructively on the local professional 
leadership that the program already supports. 

^ To help address the kinds of needs we observed in these sites, policy makers and 
program managers could establish a more explicit role for the Title I program in 
developing standards-b?sed curriculum or adapting it for low^achieving students. 

Some source of leadership is needed if Title I students are to escape their traditional 
diet of basic skills. Just as the program has always been a source of expertise and 
initiative in the field of evaluation, it could conceivably take on a similar role in 
curriculum. 

• Title 1 policy makers and program managers could strongly encourage states and 

districts to connect their professional development and other capacity building to the 
major issues of standards, curriculum, and instruction rather dm to the more 
peripheral matter of faithfully implementing packaged instructional programs. 

Schoolwide programs, which we observed in many of these sites, will become more 
widespread under the new law. These programs offer welcome flexibility in targeting special 
sen ices, but they do not customarily trigger a rethinking or overhaul of the basic program. If policy 
makers want to see schoolwide programs stimulate reform, they will have to sharpen this message. 
Schoolwide programs, no less than targeted programs, are vulnerable to poor planning. Schoolwide 
solutions alone do not remedy problems created by inept staff' or by fractionalized communities that 
neglect student needs. At the same time, we found targeted programs in which Title I is very closely 
connected to regular classroom services; other schools and districts could leam from these programs 
that they can create a seamless continuum of services whether or not Title I operates on a schoolwide 
basis. 



• A whole-school orientation must prevail if schools are to serve poor students well. 
Whether the Title I population is small or large and whether the program is targeted 
or schoolwide. Title I must be a frill partner in the education enterprise, a seamlessly 
integrated component of education in the classroom, school, district, and state. 



The overall message from this study is one of hope combined with caution. There arc a 
number of routes to stable reform; they shift with time and circumstance; and policies promoting 
flexibility with accountability will continue to serve snidents well. However, prematurely mandating 
any initiatives-new curriculums, teaching strategies, assessments, or management approaches-can 
have the deleterious effect of further burdening the most disadvantaged children. At worst, these 




children will be required to learn from chaotic, mi sunderstood curriculum materials and be assessed 
by poorly developed and little understood assessments. In shon, the complex but incomplete changes 
now in place in these sites herald a time of widespread ferment, risk, and opportunity. 
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Arizona 



ASSESSMENT SYSTEM: 


Arizona Student Assessment Program (ASAP)^ 


REPORT LE'YEL: 


State, District, School 


REPORT TITLE: 


Repon Card 


GRADES REPORTED: 


Grades 3, 8, 12 


SUBJECTS TESTED: 


Reading, writing, mathematics, science (future), social studies (future) 


POPULATION SAMPLE: 


Matrix 


ATTRIBUTES REPORTED: 


Assessment results: range of scores, mean, median. STD; 
ethnicity/race; gender; students receiving special services 



' According to Education Week (February 1, 1995), the Arizona Sure Assessment Program was 
suspended for one year as a result of questions raised about its statistical validity. Reports from the 
districts indicated inconsistencies in students’ performances on the ASAP and other tests of similar 
skills. 




GR.4DE 3 ASSESSMENT 



Reading Aasessmeac 

’^cugh reading acavitics devc*lop«l from ihc provided reading 5eiec:ons (inuc: oieces or' real literarure. good 
aonncson or real language examples) soide'^iu uirwer quesuons thac ;et k 'Junx:ng abouc reading and wnce 
responses that demo narrate thdr comprehension oi what they have read. 



The Reading Auessmem for grade 3 measured sojdent pen'orrrtance on the following Essen (iaJ Skills: 



• Teil whac a report is about 

- TdJ crmcai details from Jic report 

- Make an inference or a predicnon related to the idea tn the rep on 

• Compare one element in the report to another slemem 

• ReL ie the subjea of the report to own expenences 



Maibesantks Assessmeat 

Through mathemancai acavides developed from the provided reacting $elcc:cTS. students solve an extended 
problem or complete a task or project, use mampuiauves, and express their undersunding of matncmaucai 
concepts through vmrtg. 



The MaLhe.mancs Assessment for grade 3 measured siudcru pcrrormar.ce on die roUowuig Essen ciaJ Skills: 



- Classify and sort objects by observing relanonihips and makmg gfncraJizations 

- Use crmcrerc maienais or models to demonstrate an understanding of place vaiue 

- Explom the concepts of mutaplieacon and division with cono’cte mater.ais 

• Count >iy ones, twos, fives, and tens 

- Use nonstandard, metric and English units of measure to estimate and measure iengv.. voiume. and we:gnr 

- Use concrete maienais to recognize, represent, and aimpare halves, durds. and founns 

- Use a vahery of measurement amrucaons 

- Choose an appropriate unit of measure in a given snuaaon 

- Read and interpret Celsius and Fanrcnneit (emperamres on thermom<*icrs 

• Use digaal and convennonai docks to tell ime 



Wridng As&exsmcat 

Through wrmng acnvnxcs developed from the provided reading selections, saidents focus ’-hei: >dcas to comoose a 
story with a specnc purpose and ludicncc. write a rougn drarl, reread :t using i review cnecx usi, revise *Jie irart 
by eoiong it and then complete a onai dr art of die sioi-^. 



The ^nxmg Assessment for grade 3 measured student performance on the following Essential Skills: 



Write a story that; 

- Centers around a diaraaer who is descibed enough to be distinc; from other characers 

- Has a definite beginning, middle and end for plot structure 

- Has details that advance the plot or sequence of evoits m the story 
• Has a definite senmg 

< Show5 eviaence of editing and proofreading so that errors m spelling, puncruanon. wapTiaiizaoon. and usage 
do not impede comprehension 
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California 



ASSESSMENT SYSTEM: 


California Learning Assessment System (CLAS) 


REPORT LEVEL: 


State, District. School (individual results are scheduled to be reponed 
for grade 8 students in 1995, pending funding) 


REPORT TITLE: 


Elementary Performance Assessment 


GRADES REPORTED: 


Grade 4. 5, 8. 10 (varying subjects at each grade) 


SUBJECTS TESTED: 


English/language arts, mathematics, vrriting (grades 4. 8. and 10); 
science, history-social science (grades 5. 8. 10) 


POPULATION SAMPLE; 


Matrix* 


ATTRIBUTES REPORTED: 


Assessmem results: percent meeting performance levels; student 
background factors correlated with assessment results; student 
participation; gender; ethnicity; students receiving special services 



^ Ib late Setember 1994, Governor Wilson vetoed a bill that would have requthorized CLAS 
and asked state legislators to authorize an alternative that would assess both "basic and sophisticated 
skills'* while producing individual student results for all test takers (Education Week, October 5, 
1995, p. 13). 
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Kentucky 



ASSESSMENT SYSTEM: 
REPORT LEVEL: 

REPORT TITLE; 

GRADES REPORTED: 

SUBJECTS TESTED; 

POPULATION SAMPLE: 
ATTRIBUTES REPORTED: 



Kentucky Instructional Results Information System (KIRIS) 

State, District, School 

Student Assessment Curriculum Repon 

Grades 4. 8, 12 (beginning 1995, KIRIS "Transitional Te$is'*-the 
shon answer, multiple choice, and performance items-will be dropped 
back to grade ll; only mathematics and writing portfolios will be 
required in grade 12) 

Reading, writing portfolio, mathematics, science, social studies, arts 
and humanities, practical living/vocational studies 

Matrix 

Assessment results: number/percent meeting pertbrmance level 
standards; gender; race/ethnicity; students receiving special services; 
student quesuonnaire results; performance level by student 
questionnaire responses 
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Maryland 



ASSESSMENT SYSTEM: 


Maryland School Performance Assessment Program (MSPAP) 


REPORT LEVEL: 


State, District, School 


REPORT TITLE: 


Maryland School Performance Repon 


GRADES REPORTED: 


All grades tested: 3, 5, 8,9, 11 


SUBJECTS TESTED: 


Reading, mathematics, social studies, science 


POPULATION SAMPLE: 


Matrix 


ATTRIBUTES REPORTED: 


Assessment results: percent meeting standard; student background 
factors correlated with assessment results; student participation; 
student attainment; race/ethniciiy; gender; anendance; dropouts; post 
secondary decisions; student population characteristics; students 
receiving special services; wealth per pupil; per pupil expenditure; 
number of staff, iergch of school day/year 
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PREDtRICK COUNTY PUBLIC SCI 1C3LS 

COM. C 











New York 



Annually, the state administers and reports results from four separate testing systems: (1) Pupil Evaluation Program 
Tesis-including the Degrees of Reading test and a state-developed mathematics test (grades 3 and 6). a writing test in 
grade 5, science in grade 4, and social smdies in grades 6 and 8; (2) Program Evaluation Tests, providing means for 
three parts of the grade 4 program evaluation test in science and for the total score on the grades 6 and 9 social 
studies tests; (3) Regents Competency Tests in reading, mathematics, writing, science, global studies, and U S. 
history and government; and (4) Regents Examinations-tests of high school course knowledge in 10 content areas. 

In addition. New York’s cturent accountability system collects and reports extensive demographic, staffing, fiscal, 
and progress information about students, schools, and districts.’ In addition to reporting annually to the state 
legislature, the State Department of Education provides districts with data that can be further analyzed and customized 
into local accountability data reports. Because data are available for customized district-level use. districts vary in 
what and in how they repon information on district, school, and student progress. 

Community District #1 in New York City, for exan.. .e, reports the following information for one component of the 
program, the Pupil Evaluation Program: 



ASSESSMENT SYSTEM: 
REPORT LEVEL: 

REPORT TITLE: 

GRADES REPORTED: 
SUBJECTS TESTED: 
POPULATION SAMPLE: 
ATTRIBUTES REPORTED: 



Pupil Evaluation Program 
District 

Elementary and Secondary Schools Achievement Summaries 
Grades 2-9 

Reading, mathematics, writing, social studies, science 
Census 

Three-year summaries of percent of students achieving above grade level 
and/or above the "state reference point"; district descriptive characteristics 



’ University of the State of New York/State Education Department. (February. 1994). New 
York: The state of learning: Statistical profiles of public school districts . Albany. NY; Author. 
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New Assessment System 



The process for creating a new assessment system is developing under the auspices of the New York State 
Curriculum and Assessment Council. The Council’s April 1994 report to the Commissioner recommends new 
curriculum frameworks that redefine the state’s content and performance standards and develops an entirely new 
statewide assessment system. Attached are flow charts describing (1) the proposed new state assessment system and 
(2) the projected implementation time line (Curriculum Assessment Council, April 1994, pp. 8 and 12).* 



* Curriculum and Assessment Council. (April, 1994). Leamingrcenter curriculum and 
asse.ssment for New York State: Report of the New York State Curric ulum and Assessment Council 
to the Commissioner of^ucation and the Board of Regents . Albany, NY; Author. 
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